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Abstract 

The  most  important  characteristic  of  a  finite  automaton  is  that  it  has  a  "memory." 
By  this  we  mean  that  the  behavior  of  an  automaton  is  dependent  upon  its  past  history. 

In  this  report  several  special  cases  are  studied  in  which  the  unique  determination  of  the 
behavior  of  an  automaton  is  possible,  even  when  a  portion  of  its  past  history  is  unknown. 
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1.  INTRODUCTION 


12  3 

The  theory  of  finite  automata  waa  first  developed  by  Huffman,  Kleene,  and  Moore 
in  the  years  1954-1956.  Since  then,  a  significant  amount  of  effort  haa  gone  into  further 
investigation  and  exploration  in  this  area.  This  report  5s  the  result  of  a  study  of  some 
special  characteristics  of  a  finite  deterministic  automaton. 

A  finite  automaton  is  described  by  a  quintuple  A  =  {Z,  Z.  S.  M,  N}.  Z  *  o^.  . . }  is 

the  finite  set  of  all  possible  input  symbols  to  the  automaton;  Z  ■  ,  z2* . . }  is  the  finite 

set  of  all  possible  output  symbols  from  the  automaton,  and  S  =  {s|,  a,. . . }  is  the  finite 
set  of  the  internal  states  of  the  automaton.  M,  which  specifies  the  next  internal  state 
of  the  automaton,  is  a  function  whose  domain  is  the  Cartesian  product  S  X  Z  and  whose 
range  is  S.  N,  which  specifies  the  present  output  of  the  automaton,  is  a  function  whose 
domain  is  S  X  Z  and  whose  range  ia  Z .  The  mappings  of  the  functions  M  and  N  are 
usually  exhibited  as  the  "flow  table."  The  definitions  of  both  M  and  N  can  be  extended 
recursively  from  the  domain  S  X  Z  to  S  X  T,  where  T  is  the  set  of  all  sequences  of  the 
input  symbols  from  the  set  Z.  That  is, 

M(s,vt)  =  M(M(s,<r),t) 

N(s.o-t)  =  N(M(s,<r),  t). 

where  s  c  S,  <r  €  Z,  and  t  €  T. 

For  a  deterministic  finite  automaton,  both  of  the  functions  M  and  N  are  single- 
valued.  When  the  present  state  of  the  automaton  and  the  present  input  symbol  to  the 
automaton  are  known,  the  present  output  symbol  and  the  next  state  of  the  automaton  can 
be  determined  uniquely.  Furthermore,  if  the  initial  state  of  the  automaton  and  the  input 
sequence  to  the  automaton  are  known,  the  corresponding  final  state  and  the  sequence 
of  output  symbols  of  the  automaton  also  can  be  determined  uniquely.  On  the  other  hand, 
in  order  to  determine  the  final  state  and  the  sequence  of  output  symbols  of  the  automaton, 
it  is  necessary,  in  general,  io  have  the  initial  state  of  the  automaton  and  the  input 
sequence  to  the  automaton  specified  unambiguously.  This,  indeed,  is  the  most  impor¬ 
tant  characteristic  of  an  automaton,  that  an  automaton  has  a  "memory"  and  thus  its 
behavior  is  dependent  upon  its  past  history.  However,  there  are  special  conditions  under 
which  only  a  portion  of  the  past  history  affects  the  behavior  of  the  automaton;  these  are 
the  conditions  that  we  shall  investigate  here.  In  particular,  we  would  like  to  know 
whether  it  is  possible  to  determine  the  final  behavior  of  an  automaton  if 

(a)  The  initial  state  is  unknown,  and  only  the  input  sequence  to  the  automaton  is 
given. 

(b)  The  initial  state  is  unknown,  and  the  input  sequence  and  the  corresponding  output 
sequence  are  given. 

(c)  Both  the  initial  state  and  the  input  sequence  are  unknown,  and  only  the  output 
sequence  is  given. 
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(d)  The  initial  state  is  known,  but  only  a  portion  of  the  input  sequence  is  given. 

(e)  The  initial  state  is  known,  but  only  portions  of  both  the  input  sequence  and  the 
corresponding  output  sequence  are  given. 

(f)  Both  the  initial  state  and  the  input  sequence  are  unknown,  and  only  a  portion  of 
the  output  sequence  is  given. 

We  investigate  this  problem  under  the  first  three  conditions  in  Sections  Ill  and  IV;  the 
rest,  in  Section  V. 

In  a  broader  sense,  the  automata  for  all  of  theae  conditions  can  be  categorized  as 
"information  lossy  automata."  Since  portions  of  the  past  history  are  not  needed  in  the 
specification  of  the  final  behavior  of  the  automaton  or,  in  other  words,  the  final  behavior 
of  the  automaton  is  independent  of  theae  portions  of  the  past  history,  information  about 
them  is  lost  if  only  the  final  behavior  of  the  automaton  is  known. 


e 
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11.  PRODUCT  AUTOMATA 


2.1  NOTATION 

Let  A  =  {Z,  Z,  S.  M.  N}  and  B  »  {E,  Z'.  S',  M';  N'}  be  two  finite  automata  having  the 
same  aet  of  input  symbols.  We  define  their  product  as  A  X  B  ■  {Z,  ZXZ',  SXS',  MXM', 
NXN'},  where  ZXZ'  and  SXS1  are  Cartesian  products  of  sets,  M  X  M'  is  a  function 
that  maps  (SXS1)  X  Z  into  S  X  S',  namely 

M  X  M'((s,  s'),  e)  «  (M(s.w).M'(s'.o)). 

and  N  X  N'  is  a  function  that  maps  (SXS1)  X  Z  into  Z  X  Z1,  namely, 

N  X  N'«a.s'),e)  *  (N(a.e).  N'(a'.O), 

with  (s,  s')  c  (S,  S'),  and  v  c  Z.  Obviously,  A  X  B  is  an  automaton  itself.  Moreover,  for 
automata  A,  B,  C  . . .  having  the  same  set  of  input  symbols,  we  can  define  A  X  B  X  C  . . ., 
which  is  also  an  automaton. 

2.2  AUTOMATA  Ap  AND  A^ 

Let  A  *  {Z,  Z,  S,  M,  N}  be  an  automaton.  We  denote  the  product  of  p  copies  of  A  by 
Ap  *  {z,  zp,  Sp.  Mp,  N*5}  and  call  Ap  the  p^-power  automaton  of  A,  where  Zp  is  the  set 
of  all  ordered  p-tuples  of  Z,  Sp  ia  the  aet  of  all  ordered  p-tuples  of  S,  and 

mPHsj.Sj.  .  sp),v)  =  (M(Sj,v),  M(s2,»). .  .M(sp,  v))  • 

nPUSj.Sj.  •  sp).e)  -(NlSj.tr),  N(s2,<r)...N(sp,v)). 

We  then  can  define  aW={s.zW.sHmHnW}  as  the  unordered  p^-power 
automaton  of  A.  Here,  is  a  subset  of  the  set  of  all  the  subsets  of  Z  which  contains 
at  least  one  output  symbol  and,  at  most,  p  output  symbols;  S"1*  is  die  set  of  all  the  sub¬ 
sets  of  S  which  contains  at  least  one  state  and,  at  most,  p  states,  and 

M^({a1,  Sj. . . Sp},*)  »  {M(Sj ,  v),  M(s2> r) . . . M(sp, r)} 

nW({sj .  s2.  . . Sp}. »)  ■  {N(8j , e),  N(s2, e). . .  N(sp, »)}, 

where  the  elements  in  the  braces  are  elements  of  a  set  and  are,  therefore,  not  neces¬ 
sarily  distinct.  Figure  1  is  an  example  of  the  automata  Ap  and  A >pJ.  # 

2.  3  AUTOMATON  HOMOMORPHISM 

When  we  are  interested  only  in  the  structural  characteristics  of  an  automaton,  we 
are  not  concerned  with  its  outputs.  Thus  an  automaton  can  be  described  by  a  triple  A  * 
{z,  s,  M}  with  the  set  of  the  output  symbols  Z  and  the  output  function  N  disregarded. 

We  have 


3 


ix, 

.  ,  A| 

0  1  s‘a\ 

0  1 

•l 

(»l,l,),  (0,0)  (>3,13),  ®,P)  It,} 

{>,)  ,  l«)  i«3)  ,  ip) 

'2 

(*^,*3)*  (PfO)  {*ji 

U2)  .  »)  &2}  »  {a) 

*|/fl  (*1**3) 

(«3.«|).(P,o)  U3) 

U2)  .  M  i*j)  ,  io> 

<»2'* j)»  (P,°)  (»2<‘3)<  (°,P)  f  *| ,»2) 

(®/P)  {*2**3) » { 

A  <‘2'  *2^ 

(ij.ij),  (P,P)  (i2,»2).  («.«& 

1®}  (*l /*g)  / 

<‘2' *3^ 

(ij.ij),  (P,o)  (»2<»|)>  (°#°)  < *2**3^ 

i»2^  *  (®<P)  1®^ 

(•j.ij) 

(•2-‘,),(<«/<>)  (»j,*3),(«,P) 

A  (2) 

(»3,‘2) 

(»2,»2)r  (o,P)  <* j '*2> '  (a'a) 

<»3<‘3> 

(i2,«2),(o,a)  (»,,»,),  (a,o) 

Figure  1 

DEFINITION  1 :  f  is  an  automaton  homomorphism  of  A  onto  B  if  and  only  if  (a)  A  « 
{£,  S,  M}  and  B  *  {X,  S',  M}  are  automata  having  the  aame  set  of  input  symbols,  (b)  f  is 
a  mapping  that  maps  S  into  S',  that  is.  f:  S  -  S':  and  (c)  for  all  a  e  S  and  for  all  e  «  X, 
f(M(s,r))  =  M'(f(s).»). 

THEOREM  1:  An  automaton  A  *  {X,  S,  M}  is  a  homomorphic  image  of  its  p^-power 
automaton  Ap  for  any  positive  integer  p. 

PROOF  1 :  (a)  A  =  {X,  S.  M}  and  Ap  *  {X,  Sp,  Mp}  are  automata  having  the  aame  set 
of  input  symbols . 

(b)  Let  f  be  a  mapping  for  all  ordered  p-tuples  of  states  which  maps  each  ordered 
p-tuple  into  its  first  element,  i.e.,  f:  (Sj ,  s2> . . .  sp)  —  Sj . 

(c)  For  all  (Sj,  s2. .  .ap)  <  S**  and  for  all  e  c  X,  f(Mp(sp,r))  *  M(s2<  r). . . 

M(sp.v))  *  M(Sj,v)  and  M(f(sp),<r)  «  M<f(Sj, s2. .  .ap),e)  =  M(s,,s). 

Therefore,  f(Mp(sp,  «■))  *  M(f(sp),v).  Q.E.D. 

THEOREM  2:  Given  an  automaton  A  =>  {x,  S,  M},  A  is  a  homomorphic  image  of 
Ap  for  any  positive  integer  p. 

PROOF  2:  (a)  A^f  =  {X,  gW,  M^^Jand  Ap  ■  {X,  Sp,  Mp}  are  automata  having  the 
same  set  of  input  symbols .  ^ 

(b)  Let  f  be  a  mapping  for  all  ordered  p-tuples  of  states  which  maps  each  ordered 
p-tuple  into  the  set  that  consists  of  all  distinct  elements  at  the  p-tuple,  i.e.,  f: 
(Si,S2...Sp).{.1..2...Sp}. 

(c)  For  all  (s,.a2.  ..sp)t5T  and  for  all  r  «  X,  f(Mp(sp,e)>  «  f(M(s1>v),  M(s2,r). . . 

M(ap.r))  »  {M<s,.r),M(s2.e)...M(sp.r)},  and  mH«sp).s)  -  M^Wj.Sj.  .  .sp),r)  . 
{M(Sj . »).  M(s2, »). . .  M(sp,  e)}. 

Therefore,  f(Mp(ap.e)i  «  MH«sp).r».  Q.E.D. 
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2.4  THE  11th -POWER  AUTOMATON 

For  any  automaton  A  ■  {£,  S,  M}  conalating  of  n  internal  states ,  let  n  copies  of  A  be 
connected  in  *parallel."  That  ia,  they  accept  identical  input  aequencea.  but  are  not  inter¬ 
related  otherwiae,  as  shown  in  Fig.  2.  Considering  the  parallel -connected  system  aa  a 


INPUT 

SEQUENCE 


> 


N  COPIES  OF  A 


Figure  2 


whole,  we  have  an  automaton  whose  input  symbols  are  the  set  £  and  whose  internal  states 
are  characterized  by  the  total  states  of  the  n  copies  of  A.  This  is  exactly  the  An 
automaton. 

When  we  are  not  concerned  with  the  output  from  the  automaton,  an  automaton 
is  solely  characterized  by  its  ability  to  partition  all  input  sequences  into  congruence 
classes.  In  algebraic  language  (see  the  appendix  for  full  definitions),  the  set  of  all  input 
sequences  is  a  free  monoid  generated  by  the  set  of  all  input  symbols .  An  automaton  then 
defines  a  monoid  homomorphism  thaV  maps  the  free  monoid  into  the  finite  monoid  of  all 
congruence  classes,  as  shown  in  Fig.  3.  An  automaton  consisting  of  n  internal  states, 
in  general,  may  partition  the  set  of  all  input  sequences  into  nn  congruence  classes.  If 
we  designate  the  n  internal  states  by  Sj,  s2,  ...  sn>  for  any  input  sequence  t  we  have 
M(Sj,  t)  =  Sj,  M(s2>  t)  =  ...  M(sr,  t)  ■  sr,  where  the  .indices  i,  j  . . .  r  are  among  l, 

2  . . .  n.  We  can  consider  the  input  sequence  t  as  one  that  defines  a  mapping  that  maps 
Sj  into  Sj,  s2  into  s^  . . .  and  so  on,  or  just  a  mapping  that  maps  the  ordered  n-tuple 
(Sj,a2.  ..sR)  into  another  ordered  n-tuple  (a^a^, . . .  sr).  The  congruence  relation  ■ 
can  then  be  defined  as  tj  ■  t2  if  and  only  if  for  all  s  c  S,  M(s,tj)  ■  M(s,t2),  or  tj  ■  t2 
if  and  only  if  Mn((Sj,a2. .  .an),tj)  =  Mn((Sj,  s2. . .  sn),  t2).  Since  there  are,  in  general, 
n11  ordered  n-tuples  that  (s^,  s2> . . sR)  can  be  mapped  into,  there  may  be,  in  general,  nn 
congruence  classes  of  input  sequences.  Thus  it  is  clear  that  the  An  automaton  provides 
a  complete  picture  of  the  behavior  of  A .  The  initial  state  of  An  is  always  set  to 
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(•j,  a2-  •  •  «n).  At  any  subsequent  instant,  the  state  of  An  corresponds  to  the  congruence 
class  to  which  the  input  sequence  belongs.  Conventionally,  when  we  specify  the  behavior 
of  an  automaton  we  have  to  specify  the  initial  state  of  A .  This  specification  is  equiva¬ 
lent  to  choosing  a  particular  copy  of  A  among  the  n  copies  of  A  in  An. 


INPUT 

SYMBOLS 


Figure  3 


2.5  TRANSITION  MATRICES 

Since  every  input  sequence  t  maps  the  ordered  n-tuple  (Sj.Sg. . . «n)  into  another 
ordered  n-tuple,  we  can  consider  the  mapping  as  a  linear  transformation  that  transforms 
an  n-dimensional  vector  into  another  n-dimenaional  vector.  Following  Seshu,  Miller, 
and  Metze,4  we  represent  the  initial  state  of  An  by  the  column  matrix 


LVI 

and  the  linear  transformation  by  an  n  X  n  matrix  [T],  called  the  transition  matrix.  We 
then  have 


# 
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corresponding  to  Mn((Sj,  »2> . .  sn),  t)  ■  (Sj,  By .  .«r).  For  every  input  symbol  there 
is  a  corresponding  transition  matrix  Tft.  For  any  input  sequence  t  *  •  •  •  the 

corresponding  transition  matrix  is  T  =  TaTi,Tc  •  •  •  •  As  we  can  see,  this  matrix  repre¬ 
sentation  follows  exactly  the  model  of  the  n^-power  automaton. 

Some  of  the  properties  of  the  transition  matrix  are  stated  here  for  future  reference. 

(a)  Every  row  contains  exactly  one  nonzero  entry,  1 .  All  of  the  other  entries  are 
zeros. 

(b)  Property  (a)  is  invariant  under  multiplication  of  transition  matrices. 

(c)  An  identity  transformation  corresponds  to  a  unit  matrix. 

(d)  The  number  of  columns  for  which  all  entries  are  zero  will  not  decrease  under 
postmultiplication  of  transition  matrices. 

Property  (d)  is  not  as  obvious  as  the  other  properties,  and  it  can  be  shown  as  follows. 
Because  of  property  (a),  property  (d)  can  be  restated:  If  r  of  the  n  nonzero  entries  in 
the  transition  matrix  are  in  columns  containing  more  than  one  nonzero  entry,  then  the 


number  r  will  not  decrease  under  postmultiplication  of  transition  matrices.  Let  TaTfa  = 
T,  and  let  a^,  b^,  and  c^  denote  the  entries  in  T#,  Tb,  and  T.  Suppose  that  the 

p**1  column  of  T  contains  u  nonzero  entries,  1,  i.e.,  a.  =  a,  *  ...  a,  =  1 .  Since  the 
*  hp  *2P  \ip 


p**1  row  of  contains  exactly  one  nonzero  entry  1 ,  suppose  that  bpb  =  1 .  From  matrix 
multiplication. 


therefore,  C,  .  »C.  ...  C,  .  »  1.  Thus  property  (d)  follows. 

*i  *r  u 


III.  MEMORY  SPAN  07  AUTOMATA 


3.1  MEMORY  SPAN  WITH  RESPECT  TO  THE  INPUT 

An  automaton  is  said  to  have  a  "memory"  because  its  behavior  depends  on  its  past 
history.  Except  for  the  degenerate  case  of  automata  consisting  of  only  one  state,  tills 
statement  is  generally  true.  However,  the  behavior  of  some  automata  depends  on  remote 
history,  while  the  behavior  of  others  depends  only  on  recent  history.  In  other  words, 
in  the  former  case  we  say  that  the  automata  have  a  longer  memory  span,  while  in  the 
latter  case,  a  shorter  one.  We  shall  define  these  precisely. 

DEFINITION  2:  An  automaton  A  ■  {z,  S,  M}has  a  finite  memory  span  m  if  and  only  if 
(a)  for  all  s^,  s^  <  S  and  all  t  <  T  with  L(t)  *  m  +  1  (L(t)  means  the  length  of  t),  M(s^,  t)  ■ 
M (By  t),  and  (b)  there  exist  a^,  a .  «  S  and  tt  T  with  L(t)  *  m,  which  are  such  that 
M(Sj.  t)  *  M(Sj.t). 

Figure  4  is  an  example  of  an  automaton  having  a  finite  memory  span  2. 


Figure  4 


Figure  5 


DEFINITION  3:  An  automaton  A  »  {Z,  S,  M}  has  an  infinite  memory  span  if  and  only 
if  for  any  given  integer  N,  there  exist  Sj,  s^  «  S  and  t  €  T  with  L(t)  »  N,  which  are  such 
that  MfSj.  t)  *  M{Sj,  t). 

Figure  5  is  an  example  of  an  automaton  having  an  infinite  memory  span, 
a.  Bounds  on  the  Memory  Span 

It  is  not  true  that  an  automaton  with  a  given  number  of  states  might  have  a  finite 
memory  span  equal  to  any  positive  integer.  We  shall  obtain  an  upper  bound  and  a  lower 
bound  on  the  values  of  memory  span. 

DEFINITION  4:  In  the  square  automaton  (second-power  automaton)  A2  and  the 


unordered  square  automaton  A^,  tfaa  atataa  (s^  Sj)  in  A2  and  {s^  Sj}  in  A^,  where  Sj  # 

«j,  are  called  "compound*  states;  the  states  (s^  st)  in  A2  and  (aj  in  A®  are  callod 
"simple"  states. 

Consider  A2  and  A™  corresponding  to  two  copies  of  A  running  in  parallel.  A  com* 
pound  state  signifies  that  the  two  copies  of  A  are  in  different  states,  while  a  simple 
state  signifies  that  the  two  copies  of  A  are  in  the  same  state. 

DEFINITION  5:  There  is  a  loop  around  a  state  ijin  A  *  {Z,  S,  m}  if  there  exists  a 
nonempty  input  sequence  t,  that  is,  L(t)  >  1,  which  is  such  that  M(Sj,  t)  >  s^. 

LEMMA  1:  If  there  is  a  loop  around  a  compound  state  {s^,  Sj}  in  A^,  there  is  a  loop 
around  (Sj,  Sj)  and  a  loop  around  (Sj,  Sj)  in  A2. 

PROOF  OF  LEMMA  1:  There  exists  a  nonempty  input  sequence  t  that  is  such  that 
M^Mfsj,  Sj}.  t)  *  {sj,  Sj},  that  is,  {M(Sj,  t),  M(Sj,  t)}  «  {a^  Sj}.  Since  Sj  *  Sj  and  the  function 
M  is  single-valued,  we  have  either 

CASE  I.  M(8j,  t)  =  Bj  and  M(Sj,  t)  =  By  or 
CASE  II.  M(Sj,  t)  =  s^  and  M(Sj,  t)  =  s^ 

For  Case  I.  M^Sj.  Sj).  t)  =  <M(s  .  t).  M(Sj,  t))  =  (Sj,  Sj). 

For  Case  II,  M2((8i,  Sj).  tt)  =  (M(M(si,  t).  t),  M(M(Sj.  t),  t))  -  (M(Sj,  t).  Mfcj.  t))  -  (Sj.Sj). 

Q.E.D. 

DEFINITION  6:  In  an  automaton  A  =  {z,  S,  M},  a  Bet  of  states  s^,  Sj  . . .  (  S  is 
■structurally  indistinguishable,"  if  for  all  rd,  M(s., v)  *  M(Sj,r)  *  . 

Obviously,  any  state  is  structurally  indistinguishable  from  itself.  In  this  report, 
we  shall  abbreviate  the  term  "structurally  indistinguishable"  to  "indistinguishable." 

DEFINITION  7:  In  an  automaton  A  =  {Z,  S,  M},  a  (homomorphic)  mapping  c,  called 
"combining, "  is  defined  as:  c(Sj)  =  c(Sj)  =  . . .  =  s^  for  the  states  of  an  indistinguishable 
set  s^  Sj  . . .  .  In  other  words,  c  maps  a  set  of  indistinguishable  states  into  an  arbi¬ 
trarily  chosen  representative  state  in  that  Bet. 

DEFINITION  8:  Given  an  automaton  A  »  {Z,  S,  M},  we  define  the  combined  automaton 
Acl-<S’Sc.'  Mcl}.  where  (a)  c(s)  €  Scl  for  all  s  c  S,  and  (b)  Mcl(si,e)  ■  c(M(c-l(si),w)) 

for  all  v  €  Z  and  all  s .  €  Sc j .  Here,  c  '(Sj)  means  the  inverse  image  of  Sj  under  c. 

Although  c  l(s1)  is  not  unique,  M(c  1(Sj),v)  is  unique  (by  the  definition  of  indistinguish¬ 
able  states). 

In  general,  there  may  be  indistinguishable  sets  in  Acl  which  can  be  combined  further. 
We  adopt  the  notation  Ac2,  Ac3  ...  for  successively  combined  automata. 

LEMMA  2:  If  there  is  a  loop  around  a  compound  state  {s^  Sj}  in  A*y,  then  there 

exists  a  loop  around  one  of  the  compound  states  {c-1^),  c-1(Sj)}  in  A^2*.  (Since  c~*(Sj) 
and  c_1(Sj)  are  not  unique,  {c-1^),  c“l(Sj)}  denotes  all  possible  pairs  of  states  from 
c"1(s1)  and  c-1(Sj).) 

PROOF  OF  LEMMA  2:  Let  {•jj.  s12-  •  •  siu}  and  {"ji>  •  •  *jv}  denote  the  sets  of 
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indistinguishable  state*  in  A  which  are  mapped  Into  s^  and  *j  in  Acl,  respectively.  Thar* 
exists  a  nonempty  input  sequence  t  so  that  m|2^  ({sj,  Sj},  t)  *  {Mc]  (s^  t),  Mcj (Sj.  t)}  ■ 

{■j.  *j}*  Correspondingly,  M^^j.  Sj,},  t)  *  {*lp,  s^},  where  *ip  (  {au.  *i2* .  *siu}  and 

*jq  ‘  ‘  *ince  c(sip)  ■  s^  c<*jq>  B  *j*  Because  {sn>  si2* .  *siu}  and  {sjj, 

s  ...*P  are  sets  of  indistinguishable  states  and  t  is  nonempty,  it  follows  that 

M^({sn.  Sjj}.  t)  «  mH{su,  aJ2},  t)  «  . . .  M^Sj,. SjJ.  t)  =  . . . 

"  m{2}({-1u'  BJv>'  tJ  "  ^ip'  *jq}‘ 

Among  all  of  these  u  •  v  equalities,  there  must  be  one  that  reads 

M%V  *jq}' 0  "  K‘  *jq>’  Q- E- D- 

Lemma  2  can  be  extended  to:  If  there  is  a  loop  around  a  compound  state  in  Acr,  where 
Acr  is  any  one  of  the  series  of  automata  Acl.  Ac2>  AcJ  ....  then  there  is  a  loop  around 
a  corresponding  compound  state  in  A. 

LEMMA  3:  If  A  =  {z.  S,  M}  contains  two  or  more  internal  states,  and  if  for  all  By 

s.  e  S.  there  exists  rd  that  is  such  that  M(s,,r)  4  M(s.,  e).  then  there  is  a  loop  around 
1  1 

some  compound  state  in  A1  J. 

PROOF  OF  LEMMA  3:  Starting  with  any  compound  state  {*a,  s^}  in  A  t2*,  we  find 

that  there  exists  c  S  that  is  such  that  M^({s  ,  *  {M(sa.Sj).  Mis^e-j)}.  with 

M(sa,Sj)  4  M(sb.»j).  Also,  there  exists  »2  C  E  that  is  such  that  M^({M(sa,e-j).  M(sb, 

»l)}*»2)  =  {M(sa.e1«r2).M(sb.«r1»2l}.  with  Mis^or^)  *  M(sb.«rjS2). 

We  can  repeat  this  argument  for  as  many  input  symbols  as  we  wish  and  still  end  with 
a  compound  state.  For  an  automaton  A  containing  n  internal  states  there  are  n(n-l)/2 

/21 

compound  states  in  its  unordered  square  automaton  A1  If  we  repeat  this  argument 
for  more  than  n(n-l)/2  steps,  at  least  one  compound  state  is  visited  more  than  once. 
Thus  there  is  a  loop  around  that  compound  state.  Q.E.D. 

We  are  now  able  to  prove  the  following  theorem. 

THEOREM  3:  An  automaton  consisting  of  n  internal  states  has  a  memory  span  either 
equal  to  infinity  or  equal  to  n-2  or  less. 

PROOF  3:  Suppose  that  an  automaton  A  =  {z,  S,  M}  has  a  finite  memory  span  larger 

than  n-2;  that  is.  there  exist  states  s^,  Sj  and  an  input  sequence  t  of  length  n-1  which 

are  such  thatM(s.,  t)#  M(s4,  t).  We  claim  that  the  automaton  then  must  have  an  infinite 
*  J  * 

memory  span.  We  have  to  show  that  there  is  a  loop  around  a  compound  state  in  A  . 

However,  from  Lemma  1 ,  we  have  only  to  show  that  there  is  a  loop  around  a  compound 

state  in  A^2}.  The  portion  of  the  transition  diagram  of  A^  that  corresponds  to  the 
input  sequence  t  =  SjS2  . . .  vn_j  is  shown  in  Fig.  6.  If  within  the  n-1  steps  of  transition 
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n  COMPOUND  STATES 


(n  —  1)  COMPOUND  STATES  SIMPLE 

STATE 


Figure  7 


TWO  COMPOUND  STATES  (n-2)  SIMPLE  STATES 


Figure  8 

any  compound  state  is  visited  more  than  once,  there  is  certainly  a  loop  around 
that  state;  if  not.  we  repeatedly  combine  all  seta  of  indistinguishable  states  to 
form  Acp  (the  r  ^-combined  automaton)  either  until  no  further  combination  is  pos¬ 
sible  or  until  Sy  and  sg  become  two  indistinguishable  states  in  Acr>  (Notice 

that  the  n  compound  states  in  Fig.  6  are  still  compound  states  in  A^  because  none  of 
the  n  pairs  of  states  would  become  indistinguishable  before  sy  and  sg  are  combined.) 

We  can  now  examine  two  possibilities:  (a)  No  further  combination  is  possible  in  AC|>. 
Because  Acr  contains  at  least  two  states,  sy  and  sg,  by  Lemma  3  there  is  a  loop  around 

a  compound  state  in  A^  .  (b)  The  pairs  sy  and  sg  are  indistinguishable  in  AC(>.  Com¬ 
bine  Sy  and  sg  to  form  Ac^r+1j.  The  portion  of  the  transition  diagram  of  A^+1  j  that 

corresponds  to  the  input  sequence  t  is  shown  in  Fig.  7.  If  sw  and  sg  are  distinguishable, 
we  return  to  the  argument  of  possibility  (a).  If  sw  and  sg  are  indistinguishable,  we  com 
bine  them  to  form  Ac(r+2)  repeat  the  argument  above.  The  procedure  of  combining 


indistinguishable  states  can  go  on,  at  most,  to  Ac(r+n_2)«  •i**ce  the  portion  of  the  transi¬ 
tion  diagram  of  Ac*r+n_2)  corresponding  to  the  input  sequence  t  is  that  which  is  shown 

in  Fig.  8.  Since  after  (n-2)  steps  of  combining  indistinguishable  states,  Ac(r+n-2)  wou*<* 
have  only  two  states,  {*a<  *b}  =  {«c*  *<}}  in  Fig-  8-  There  is  still  an  input  symbol  e-j, 
however,  that  will  lead  a  compound  state  to  a  compound  state.  Therefore,  there  is  a 

h\ 

loop  around  a  compound  state  in  Ac(r+n-2)' 

By  Lemmas  1  and  2,  we  then  prove  Theorem  3.  Q.E.D. 

The  proof  of  this  theorem  brings  up  an  interesting  point.  For  an  automaton  A  * 

{£,  S,  M}  consisting  of  n  states,  even  when  the  function  M  is  only  partially  specified 

(that  is,  the  flow  table  is  partially  specified), 
as  long  as  the  specified  values  of  M  ensure 
the  existence  of  an  input  sequence  of  length 
n-1  which  will  bring  any  two  different  states 
into  different  states,  the  automaton  has  an 
infinite  memory  span  no  matter  how  the  rest 
of  the  values  of  M  are  specified.  As  an 
example,  no  matter  which  values  are  assigned 
for  the  bars  in  the  flow  table  in  Fig.  9,  the 
automaton  will  have  an  infinite  memory  span. 
THEOREM  4:  If  a  strongly  connected 
automaton3  consisting  of  n  states  has  a  finite  memory  span  m,  then  am+1  >  n,  where 
a  is  the  number  of  possible  input  symbols. 

PROOF  4:  There  are  «m+ 1  different  input  sequences  of  length  mtl .  Starting  from 
any  arbitrary  state  s.,  the  automaton  can  enter,  at  most,  «m+1  different  final  states 

*  SV4  X  1 

after  m+1  steps  of  transition.  Suppose  that  n  >  e  .  There  then  must  be  a  state  (or 
states),  say  s^,  that  is  not  included  in  these  om+1  final  Btates.  However,  there  exist 
an  input  sequence  t  of  length  mtl  and  an  initial  state  Sj  which  are  such  that  M(Sj,  t)  *  s^. 
Then  M(sy  t)  *  M(si>  t)  is  a  contradiction  of  the  statement  that  the  memory  span  equals  m. 

Q.E.D. 

b.  Canonical  Form  of  an  Automaton  Having  a  Finite  Memory  Span 


M(s|,  001)  =  s4 
M(.j,  001)  =$, 


Figure  9 


Let  us  define  a  series  of  relations  RQ,  R)(  R2  ■  •  •  ‘  *  a*  *ollows: 

Rq:  Sj  Rc  a,  if  and  only  if  M(Sj,  A)  *  M(Sj,  A),  where  A  denotes  the  empty  input 
sequence.  (Since  we  assume  that  all  states  in  the  automaton  are  distinct, 
only  Bj  Rq  Sj  is  true.) 

Rj!  Sj  Rj  Sj  if  and  only  if  M(Sj, r)  Rq  M(sj,e)  for  any  input  symbol  e. 

R^:  Sj  R^  Sj  if  and  only  if  Mfs^e)  Rk_t  M(Sj,  v)  for  any  input  symbol  v.  In  other 
words,  Sj  Rjj  Sj  if  and  only  if  M(Sf,  t)  •  M(Sj,  t)  for  any  input  sequence  t  of 
length  k. 

It  is  obvious  that  all  of  the  R's  are  equivalence  relations,  and  thus  they  define  a  series 
of  partitions  PQ,  Pj  . . .  P^,  Pk  ...  on  the  set  of  internal  states. 
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We  claim  that  P^.j  ia  a  refinement  of  P^,  that  is,  for  any  pair  of  states  Sj  and  a,, 
if  Sj  Hk_1  then  s^  R^  s,.  Sj  R^.j  Sj  means  that  for  any  input  sequence  t  of  length 
k-1,  M(Sj,  t)  ■  M(Sj.t).  Thus  M(sj,  tr)  ■  M(§j,  tej  for  any  input  symbol  e.  Therefore, 

*i  Procedure  for  forming  these  successive  partitions  will  terminate  when* 

ever  Pj_j  is  identical  with  P y  Therefore,  this  procedure  will  terminate,  at  most,  at 
Pn-1  because  PR_j  will  consist  of  only  one  block,  (n  is  the  number  of  internal  states.) 
Thus  we  have  the  following  theorems. 

THEOREM  5:  An  automaton  will  have  an  infinite  memory  span  if  the  procedure  for 
forming  successive  partitions  PQ,  Pj  . . .  terminates  at  a  partition  Pj  that  consists  of 
more  than  one  block. 

PROOF  S:  If  the  partition  terminates  at  Py  then  for  any  two  states  Sj  and  Sj  that 
are  not  in  the  same  block  of  Pj.  there  is  an  input  symbol  that  is  such  that  Mfs^Vj) 
and  MfSyVj)  are  not  in  the  same  block  in  Pj.  (Otherwise,  Pj+J  *  Pj.)  Repeating  this 
argument  for  ti>e  states  M(aj,  ?j)  and  M(Sj,  «Tj),  we  have  an  input  symbol  e2  that  is  such 
that  M(si,v’l«r2)  and  M(Sj,  c^o^)  are  not  in  the  same  block  in  Pj.  Repeating  again,  we 
can  have  an  input  sequence  t  of  any  arbitrary  length  so  that  Mfs^,  t)  and  M(Sj,  t)  are  not 
in  the  same  block.  Therefore,  M(Sj,  t)  *  M(Sj,  t)  because  Pj  is  a  partition  (blocks  in  Pj 
are  disjoint).  Q.E.D. 

THEOREM  6:  An  automaton  will  have  a  finite  memory  span  j-1  if  the  series  of  par¬ 
titions  PQ,  Pj  . . .  terminates  at  a  Pj  that  consists  of  only  one  block. 

PROOF  6:  si  Rj  Sj  means  tiiat  for  any  input  sequence  of  length  j,  M(Sj.  t)  =  M(Sj,  t). 
Since  Pj  consists  of  only  one  block,  this  equality  holds  true  for  any  pair  of  states.  On 
the  other  hand,  since  Pj_j  consists  of  two  or  more  blocks,  there  exist  a  pair  of  states 
Sj  and  Sj  and  an  input  sequence  t  of  length  j-1  which  are  such  that  M(Sj,  t)  *  M(Sj,  t). 

Q.E.D. 

Theorem  3  can  be  proved  alternatively  aa  follows .  Since  the  series  of  partitions 
PQ.  Pj  . . .  will  terminate,  at  most,  at  PR_j ,  then  MJsj,  t)  =  M(Sj,  t)  for  any  input  sequence 
t  of  length  n-1  and  any  pair  of  states  s^  and  Sj. 
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This  series  of  partitions  P  ,  P,  ...  corresponds  exactly  to  the  step-by-step  com¬ 
binations  of  indistinguishable  states.  A  set  of  states  that  are  in  the  same  block  in  Pk 
is  indistinguishable  after  k  steps  of  combination.  Therefore,  the  canonical  form  of  an 
automaton  having  a  finite  memory  span  is  one  that  can  be  reduced  to  an  automaton  con¬ 
sisting  on  only  one  internal  state  after  repeated  combinations  of  indistinguishable  states. 
(See  Fig.  10  for  an  automaton  with  a  finite  memory  span  and  Fig.  11  for  one  with  an  infi¬ 
nite  memory  span.) 

c.  Essential  Part  of 

Suppose  that  we  do  not  know  the  initial  state  of  an  automaton  but  do  know  the  input 
sequence  to  the  automaton  and  would  like  to  determine  the  present  state  of  the  automaton. 
In  general,  with  such  limited  knowledge,  it  is  impossible  to  determine  the  present  state. 
If,  however,  the  automaton  has  a  finite  memory  span,  say  equal  to  m.  the  present  state 
can  be  determined  when  (mi-1)  or  more  of  the  most  recent  input  symbols  are  known.  From 
the  definition  of  an  automaton  having  a  finite  memory  span  m,  the  automaton  will  termi¬ 
nate  at  the  same  state  for  a  given  input  sequence  of  length  that  is  equal  to  or  larger  than 
(m+1)  no  matter  what  the  initial  state  is.  In  other  words,  although  there  is  initially  com¬ 
plete  ambiguity  about  the  state  of  the  automaton  (the  automaton  can  be  in  any  initial  stated 
this  ambiguity  will  eventually  be  removed  after  m+1  steps  of  transition.  If  we  look  at 

the  unordered  nth-power  automaton  A^,  we  can  see  the  manner  in  which  the  ambiguity 
is  narrowed  down  step  by  step.  From  the  initial  set  of  states  {s^,  s2- .  .  8R}  (any  state 
could  be  the  initial  state),  a  transition  will  lead  to  another  set  of  states  {s^.Bj.  •  »r}  which 
are  the  possible  states  that  the  automaton  will  be  in  after  that  transition.  As  we  can  see, 
the  number  of  states  in  the  set  {s^,  Sj. . .  sr}  indicates  the  amount  of  ambiguity  that  exists, 
as  far  as  the  state  that  the  automaton  may  be  in  is  concerned.  From  property  (d)  of  the 
transition  matrices  (see  Sec.  11)  we  know  that  this  ambiguity  will  never  increase.  Further 
transitions  may  further  decrease  the  ambiguity.  If  no  ambiguity  exists  after  any  (m+1) 
steps  of  transition,  the  automaton  is  said  to  have  a  finite  memory  span.  In  order  to  deter¬ 
mine  the  memory  span  of  an  automaton  it  is  not  necessary  to  examine  the  complete  A'n*. 
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W«  can  look  at  only  a  portion  of  which  conaiata  of  all  atataa  that  can  ba  reached  from 

{a., a,. .  .a  1.  This  part  of  carriea  all  of  the  information  that  we  need,  and  ia  called 
12 

the  essential  part  of  A ‘n*.  (See  Fig.  12.)  In  the  example  in  Fig.  12  after,  at  moat,  three 
tranaitiona,  no  ambiguity  about  the  atate  of  the  automaton  will  exiat.  The  diagram  of  the 

eaaential  part  of  A^  can  be  illuatrated  in  a  more  explicit  faahion,  called  the  tree 
of  the  eaaential  part  of  A the  tree  of  the  eaaential  part  of  A of  Fig.  1 2  ia  illuatrated 
in  Fig.  13.  Notice  that  we  atop  extending  any  branch  of  the  tree  once  ambiguity  no 


Figure  14 


longer  exists  along  the  branch. 

Therefore  the  tree  of  the  essential  part  of  A^nl  can  be  employed  to  check  the  memory 
span  of  an  automaton.  As  indicated  above,  after  n-1  steps  of  transition  (n  is  the  number 
of  internal  states  of  the  automaton),  no  ambiguity  will  exist  for  an  automaton  having  a 
finite  memory  span.  On  the  other  hand,  a  certain  ambiguity  after  (n-1)  steps  of  transi¬ 
tion  or  a  loop  around  any  set  containing  more  than  one  state  indicates  that  the  automaton 
has  an  infinite  memory  span.  The  automaton  in  Fig.  14  has  an  infinite  memory  span 
because  of  the  loop  around  {sj,  s^}. 

d.  A  Series  of  Partitions  Related  to  the  Tree  of  Essential  Part  of  A^ 

We  define  a  series  of  relations  Tn_j,  Tn_2,  .  . .  Tn_^+1,  TR_k  ...  as  follows: 

T  , :  s.  T  ,  s.  for  any  pair  of  states  s.  and  s.. 
n-l  1  n-l  j  1  J 

T  If  s.  T  .  s.,  then  M(s.,o)  T  ,  M(s.,o)  for  any  o  £  2. 
n-Z  l  n-i  j  l  n  c  j 

(If  there  exists  a  state  st  that  is  such  that  no  state  Sj  and  input  will  give 
M(s^,  o)  =  st,  we  define  st  Tn_2  8t.  The  same  definition  is  applied  in  the 
successive  relations.) 


Tn_k:  If  s.  Tn_k+1  s.,  then  M(si(  o)  Tfi_k  M(s.,o)  for  any  o  €  2. 

Moreover,  all  of  the  T's  are  defined  as  transitive  relations.  In  other  words,  if  Sj  Tn_k  s^ 

and  s  T  ,  s  ,  we  then  have  s.  T  ,  s  by  definition.  We  can  show  that  the  T's  are 
j  n-k  m  i  n-k  m 

equivalence  relations: 

(a)  Reflexivity:  Proved  by  induction.  Tn_j  is  reflexive  because  by  assumption  s. 

T  ,  s,  for  any  s.,  s..  Assume  that  T  ...  is  reflexive.  For  any  s.,  if  there  exist 

n — 1  j  l  j  ^  kti  i 

sk  and  o’  that  are  such  that  M(sk<o)  =  then  s.  TR_k  s.  because  sk  TR_k+1  sk;  if  there 
does  not  exist  sk  and  o  that  are  such  that  M(sk> o)  =  s^  then  s.  Tn_k  s.  by  definition. 
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(b)  Transitivity:  By  assumption. 

(c)  Symmetry:  Proved  by  induction.  T^_j  is  obviously  symmetric.  Assume  that 
Tn-k+l  is  symmetric  •  Let  sj  Tn-i{  sj' 

CASE  I:  There  exist  s^,  sm,  and  input  symbol  <r  that  are  such  that  M(Sq,  <r)  =  s^  and 

M(s  .o')  =  s.,  where  s  T  .  s  By  assumption,  s  T  .  s  gives  s  T  .  s  , 
'  m  j  q  n-k+1  m  J  q  n-k+1  m  6  m  n-k+1  q‘ 

and  thus  M(s  ,<r)  T  .  M(s  ,(r).  Therefore,  s,  T  .  s.. 

m  n-k  q  j  n-k  1 


Tn-k  8j  and 


CASE  II:  There  exists  a  chain  relation  s.  T  b  s„  T  ,  s,  T  .  s„ 

1  n-k  a  n-k  b  n-k  c 

exist  6^,  st,  su,  sv,  sw,  s^,  . . .  ando-j,  a 2,  o -y  ...  that  are  such  that  sq  Tn-k+l 

T  ,  . ,  6  ,  8  T  .  . .  s  ,  s  T  ,  . .  s  and 
v  w  n-k+1  x  y  n-k+1  m 


st'  Su  n-k+1 


Mis^orj)  =  Si 

M<su'<r2)  =  8  a 


Mis^HSb 


M<afrl>  =  8  a 


m<8v*'2>  =  sb 
M,Vfj)  =  sc 


msy,*4)  =  sc 


sj* 


or  pictorially  as  shown  in  Fig.  15.  As  proved  in  Case  I,  we  have  s&  Tn  ^  s^,  T  . 

s  ,  s  T  .  s,  ,  s.  T  .  s  .  Thus,  s.  T  ,  s..  Therefore,  the  relations  T  T  .  . 
a  c  n-k  b  j  n-k  c  j  n-k  1  n-1'  n-2 


s. 

i 


s 

a 


sb 


s 

c 


$. 

J 


Figure  15 


T  ....  define  a  series  of  partitions  Q  , ,  Q  . .  .  Q  ..... 
n-k  r  n-1  n-2  n-k 

We  claim  that  Qn_jt  is  a  refinement  of  Qn _jt+|  •  This  can  be  proved  by  induction. 

Q  is  obviously  a  refinement  of  Q  , .  Assume  that  Q  .  .  is  a  refinement  of  Q  . 
n~t  n — i  n-K+i  n— K+z 

Let  si  Tn_k  Sj,  and  we  have  two  cases  that  are  identical  with  the  last  two 
cases - 

CASE  I:  There  exist  s^,  sm>  and  input  symbol  <r  that  are  such  that  Mis^.e)  =  sA 
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and  M(am.»)  =  m  where  aq  Tn.k+1  am 
Tn-k+lM(8m  ‘  “ 


By  assumption,  sq  TR_k+2  sm  and  thus  M(sq,  <r) 


*)■  Therefore*  8i  Tn-k+l  8j‘ 

CASE  II:  There  exists  a  chain  relation  as  shown  in  Fig.  15.  By  assumption,  s 


Tn-k+2  8t'  8u  Tn-k+2  8v' 


T-  ’  ~  8-‘  8-  T— sm-  Thu8'  8i  Tn-k+l  8a*  8a  Tn-k+l 


n-k+2  “x*  y  n-k+2 
8b'  8b  Tn-k+l  V  8c  Tn-k+l  V  Therefore,  ^  Tn.k+,  s.. 

For  any  Sj  that  is  in  a  block  consisting  of  more  than  one  state  in  Qn_k<  there  exist 
a  state  Sj  in  the  same  block  as  s^,  a  pair  of  states  sq  and  sm,  and  an  input  sequence  t 
of  length  k-1,  which  are  such  that  M(sq,  t)  =  s^  and  M(sm,  t)  =  s^.  This  statement  is  not 
quite  obvious  and  can  be  shown  as  follows.  The  partition  Qn_k  is  closely  related  to  sets 

of  states  at  level  n-k  of  the  tree  of  the  essential  part  of  As  a  matter  of  fact,  from 

the  tree  of  the  essential  part  of  A^,  if  we  put  the  unions  of  all  sets  of  states  that  are 
chain-connected  into  blocks  and  put  all  states  that  are  not  reachable  at  level  n-k  into 
separate  individual  blocks,  we  shall  have  Qn_k.  This  fact  can  be  proved  by  induction. 

It  is  certainly  true  for  Qn_j  and  Qn_2  by  the  definition  of  Q  _j  and  Qn  2-  Suppose  that 
this  is  true  for  Qn_k+1 .  Let  {ij,  {ij.  {I3},  {j,},  {jJ,  {jjf  .  .  .  {K,}?  {kJ.  {Kj}  . . . 

denote  sets  of  states  at  level  n-k+1  in  the  tree  of  the  essential  part  of  A^n^,  where  the 
I’s,  as  well  as  the  J's  and  K's,  are  chain-connected.  The  sets  of  states  at  level  n-k 


be  denoted  by  mH^},^),  MHllJ.or^ 


On 


the  other  hand.  Qn_k+1  consists  of  blocks  {{l 3 } U {l2} U {l 3}},  {{J1}U{j2}U{j3}},  ...  {Vj}, 

{V2},  where  {V}}  and  {V2}  are  states  that  are  not  reachable  at  level  n-k+1 .  Then  Qn_k 
would  consist  of  mH{{I1}U{I2}U{I3}}.ot2).  mH{{Jj}U{J2}  U 

{J3}}.<r,).  mH{{Jj}U{J2}U{j3}},<t2)  ...  mH{vi},v2),  with  the  chain- 

connected  sets  combined  into  blocks  and  also  would  consist  of  states  that  are  not  reach¬ 
able  at  level  n-k.  Since  {ij},  {l2},  {l^}  are  chain-connected,  M^({lj},  w ^ ),  M^({l2}, iTj), 
M^({l3},  <Tj  )  are  chain-connected.  Therefore,  M  {n}({l,},  ^ j )  U  mH{I2},  o-j)  U  mH{I3}, 

OTj)  =  M^n  }({{l1}U{l2}U{l3}},o-1).  Since  Vj  consists  of  only  a  single  state,  M 
either  is  a  state  that  is  not  reachable  at  level  n-k  or  is  included  in  some  other  set.  This 
completes  the  proof  that  Qn_k  is  formed  by  the  unions  of  connecting  sets  plus  individual 
blocks  for  states  that  are  not  reachable  at  level  n-k.  Therefore,  if  Sj  is  in  a  block  con¬ 
sisting  of  more  than  one  state  in  Qn_k,  there  must  be  a  set  of  states  consisting  of  Sj 

and  8^  at  level  n-k  of  the  tree  of  the  essential  part  of  A^nh 
Tlieorems  7  and  8  will  then  follow  immediately. 

THEOREM  7:  An  automaton  will  have  an  infinite  memory  span  if  the  procedure  for 

forming  successive  partitions  <3, ,  Q__,  . . .  terminates  at  Q  .,  a  partition  that  con- 

n  1  Ufa  n 

sists  of  fewer  than  n  blocks  (that  is,  there  is  a  block  consisting  of  more  than  one  state). 

PROOF  7:  The  termination  of  the  series  of  partitions  means  that  if  we  continue  to 
form  partitions  for  successive  steps,  they  will  all  be  identical  with  Qn_j-  This  result 
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implies  that  for  all  input  sequences  of  any  length  there  is  at  least  one  subset  consisting 

of  more  than  one  state  at  that  level  of  the  tree  of  the  essential  part  of  Q.E.D. 

THEOREM  8:  An  automaton  will  have  a  finite  memory  span  j  -  2  if  the  series  of  suc¬ 
cessive  partitions  terminates  at  Qn_j<  a  partition  that  consists  of  n  blocks. 

PROOF  8:  The  proof  of  this  theorem  is  obvious. 

Moreover,  Theorem  3  can  be  proved  immediately  by  observing  that  the  series  of  Q's 
are  refinements  of  the  previous  Q's. 

Another  interesting  point  comes  up  from  the  examination  of  this  series  of  partitions. 
We  can  tell  that  an  automaton  has  an  infinite  memory  span,  even  when  the  function  M  is 


Qn-1  { 

Qn_2  =  l  sl,s2,s3's4,J5's6  ^ 


Figure  16 

partially  specified,  if  the  specified  values  of  M  ensure  that  the  serieB  of  partitions  Qn-1 » 
Qr_2  *  •  •  terminates  at  one  consisting  of  less  than  n  blocks.  (See  Fig.  16.)  Since 
Qn_j  =  Qn_2  in  Fig.  16,  the  automaton  will  have  an  infinite  memory  span  regardless  of 
the  values  assigned  to  the  barred  entries  in  the  flow  table. 

e.  Partial  Information  from  Input  Sequences 

For  an  automaton  having  a  finite  memory  span  m,  any  input  sequence  of 
length  (m+1)  will  furnish  complete  information  about  the  present  state  of  the 
automaton.  On  the  other  hand,  for  an  automaton  having  an  infinite  memory  span, 
there  always  exists  at  least  one  input  sequence  of  any  arbitrary  length  which 
does  not  supply  enough  information  to  enable  the  unique  specification  of  the  state 
of  the  automaton.  Although  the  complete  information  about  the  state  of  the  autom¬ 
aton  will  not  be  furnished  by  some  input  sequences,  there  may  be  some  partial 
information  available.  In  other  words,  although  the  input  sequences  cannot  com¬ 
pletely  remove  the  ambiguity  about  the  present  state  of  the  automaton  when  the 
initial  state  is  unknown,  they  can  at  least  narrow  down  the  ambiguity  to  a  certain 
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extent,  as  can  be  seen  from  the  tree  of  the  essential  part  of  A'n'.  For  example,  let  us 
look  at  the  automaton  in  Fig.  14.  If  the  input  sequence  is  a  string  of  zeros,  then  we 
never  can  tell  exactly  whether  the  automaton  is  in  Sj  or  s^,  regardless  of  the  number 
of  zeros  that  we  may  observe.  Knowing  that  the  input  is  a  "0"  (a  "1"),  however,  enables 
us  to  determine  that  the  state  of  the  automaton  is  either  Sj  or  s^  (cither  s^  or  s^)  and 
reduces  the  ambiguity  from  four  possible  states  to  two  possible  states.  Therefore,  if 
we  know  the  previous  input  symbols  (0  or  1),  we  only  need  the  extra  information  to  dis¬ 
tinguish  Sj  from  Sj  or  Sg  from  s^  in  order  to  specify  uniquely  the  present  state  of 
the  automaton.  For  this  purpose,  we  can  extend  the  tree  of  the  essential  part  of 


A*n'  to  a  certain  level  and  determine  the  ambiguity,  corresponding  to  each  input  sequence, 
about  the  state  of  the  automaton  at  that  level.  As  we  have  indicated,  whenever  there  is 
a  loop  around  any  set  containing  more  than  one  state,  further  extension  of  the  tree  will 
not  reduce  the  ambiguity  within  that  set  of  states. 


f.  New  Model  of  an  Automaton 


As  indicated  in  Section  I,  a  finite  automaton  is  characterized  by  a  quintuple  A  = 

{2,  Z,  S,  M,  N}.  The  functions  M  and  N  can  be  written  more  explicitly  as 

...  t  t.  t+1 
M(s  ,  <r  )  =  s 

Nts1,^)  =  s\ 

where  the  superscript  t  is  the  index  of  successive  time  periods.  From  our  discussion, 
we  see  that  the  past  input  sequence  plus  some  extra  information  will  specify  uniquely 
the  state  of  the  automaton.  This  extra  information  is  needed  whenever  the  automaton 
does  not  have  a  finite  memory  span.  Suppose  that  k  of  the  latest  input  symbols  to  the 
automaton  are  known.  The  set  of  states  corresponding  to  this  input  sequence  at  level 

n  -  k  -  1  in  the  tree  of  the  essential  part  of  A^  will  be  the  set  of  possible  present  states 
of  the  automaton.  For  all  possible  input  sequences  of  length  k,  the  set  that  contains 
the  largest  number  of  states  at  level  n  -  k  -  1  displays  the  largest  possible  ambiguity 
about  the  present  state  of  the  automaton  that  k  of  the  latest  input  symbols  are  not  capable 
of  removing.  We  now  define  a  new  variable,  called  the  "substate"  of  the  automaton, 
which  will  assume  the  values  rj,  r r^  ....  When  k  of  the  latest  input  symbols  are 
known,  the  number  of  substates  will  be  equal  to  the  number  of  states  in  the  largest  set 

at  level  n  -  k  -  1  in  the  tree  of  the  essential  part  of  A^.  We  shall  then  assign  different 
substates  to  denote  different  states  in  the  same  set,  so  that  knowing  the  past  input 
sequence  and  the  substate  will  be  sufficient  to  determine  the  state  of  the  automaton.  We 
may  then  write 


t  _  t-1  t-2  t-k  t. 

s  -  ,  <r  ,  . .  .o-  ,  r  ), 

where  H  is  the  functional  relation  between  s*  and  o-*  1 ,  <rt-^ 
t+1  . 

s  ,  we  have 


r*.  Since  M{s*,  <r*) 
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M(H<<rt_1,<r4"2. 


.  (T 


'k,  r4),  o-1)  =  Hlo-4,*4'1 


.fft'k+1,rt+1). 


In  general,  changing  the  value  of  any  argument  of  the  function  M  changes  the  value  of 
s4+1,  which,  in  turn,  would  change  the  value  of  r4+4.  Therefore,  we  can  express  explicitly 


r 


t+1 


Flo-4,  o- 


t-1 


t-k+1  t-k  t. 
.o-  ,a  ,  r  ) 


We  propose  now  that  an  automaton  can  be  described  by  a  quintuple  A  =  {2,  Z,  R,  F,  G}. 

"  =  {°Vff2'  •  •}  and  z  =  {zi>  z2'  •  are  tlle  finite  set  of  input  symbols  and  output  symbols; 
R  =  {i-j.r,,,  .  .}  is  the  set  of  substates;  F  is  a  function  that  maps  all  ordered  (k+2) -tuples 

(<r4,<r4  4.  .  ,<r4  k,  r4)  into  R,  as  expressed  above;  G  is  a  function  that  maps  all  of  these 
ordered  (k+2)-tuples  into  Z,  namely 


t  t  t-1 

z  =  G(o-  ,  cr 


„t-k+l 
.or  ,  (T 


■k  t. 

» r  ). 


Therefore,  given  an  automaton  represented  in  the  conventional  way  A  =  {2,  Z,  S,  M,  N}, 
we  can  have  another  equivalent  representation  A  =  {2,  Z,  R,  F,  G},  where  the  set  R  and 


Figure  17 

the  functions  F  and  G  are  different  for  different  values  of  k,  the  number  of  known  past 
input  symbols.  The  function  H  defined  above  will  then  indicate  the  relations  between 
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the  two  representations.  For  the  automaton  illustrated  in  Fig.  17  we  construct  the  func¬ 
tion  H  for  k  -  1  and  k  =  2,  as  shown  in  Figs.  18  and  19,  respectively. 

For  k  =  1,  we  define 

H(0,  rt)  =  s,  H(0,  r2)  =  s2  H(0,  rj  =  s4 

H»l,r1)  =  s3  H(l,r2)=s5  H(l,r3)  =  s6 

and  obtain  the  table  illustrated  in  Fig.  18.  For  example, 

M(H(0,  Tj ),  0)  =  M(Sj ,  0)  =  =  H(0,r,) 

N(H(0,  r  j ),  0)  »  N(s,.0)  *  0 
M(H(0,ri),  1)  =  MlSj,  1)  =  s5  =  H(l,r2) 

N(H(0,  r j),  1)  *  N(Sj,  1)  =  1.  etc. 


For  k  =  2,  we  define 


H(00,  r,)  =  Sj 
H(01 ,  r j )  =  s5 
H(10,  r 3 )  =  Sj 
H(1 1 ,  r  j  >  =  s3 


H{00,r2)  =  s2 
H(01,r2)  =  s6 
H(10,r2)  =  s4 
H(l!,r2)  =  s3 


and  obtain  the  table  illustrated  in  Fig.  19.  Notice  that  H  can  have  the  same  value  for 
different  arguments,  for  example,  H(00,rj)  =  8j,  H(10,  rj)  =  8j,  because  Sj  has  appeared 
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in  more  than  one  set  of  states  at  level  n-3  of  the  tree.  Another  point  that  is  worth 
noticing  is  the  fact  that  because  the  set  s3  consists  of  only  one  state,  both  substates 
rj  and  r2  are  assigned  to  By  This  is  the  reason  that  there  are  optional  entries  in  the 
flow  table  shown  in  Fig.  19.  Suppose  that  we  define  H  as 
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H(OO.rj)  *  Bj 
H(01,  Tj)  =  s5 
H(10,  Tj)  =  s4 
H(1 1 ,  r j)  =  s3 


H(00,r2)  =  b2 
H(01.r2)=s6 
H(10,r2)  =  8j 
H(ll.r2)  =  Sj 


Some  of  the  entries  in  the  flow  table  will  be  as  shown  in  Fig.  20.  Notice  that  all  four 
entries  in  Fig.  20  correspond  to  a  transition  to  Sj .  Since  H(00,  r^  =  H(10,  r2)  =  Sj, 
whether  the  next  substate  should  be  r^  or  r,  depends  on  the  past  input  symbols.  From 


Figure  20 


H(<r4  ^e4,  r4)  =  s4+1,  we  see  that  since  <r4  1  and  <r4  are  given,  we  would  choose  r4  so  that 
the  function  H  will  yield  the  correct  s4+1 . 

g.  Transient  States 

DEFINITION  9:  In  an  automaton  A  =  {E,  S,  M},  a  state  b.  (  S  is  a  transient  state  if 
(a)  there  exists  an  input  symbol  <r  that  is  such  that  for  every  input  sequence  t,  M(M(s., 
a),  t)  *  Sj,  or  (b)  there  exists  an  input  sequence  t  that  is  such  that  M(sj,  t)  is  a  transient 
state . 

DEFINITION  10:  In  an  automaton  A  =  {E,  S,  M},  a  state  s^  e  S  is  a  transient  state  of 
finite  duration  d  if  (a)  s.  is  a  transient  state,  (b)  for  any  state  s^  and  for  any  input 
sequence  t  with  L(t)  >  d,  M(Sj,  t)  *  s,,  and  (c)  there  exist  a  state  s^  and  an  input 
sequence  t,  L(t)  =  d,  which  are  such  that  M(8^,t)  =  s. . 

DEFINITION  11:  In  an  automaton  A  *  {E,  S,  m},  a  state  s.  (  S  is  a  transient  state 
of  infinite  duration  if  (a)  Sj  is  a  transient  state,  and  (b)  for  any  positive  integer  N, 
there  exist  a  state  Sj  and  an  input  sequence  t,  L(t)  >  N,  which  are  such  that  M(Sj,  t)  & 

si- 

DEFINITION  12:  In  an  automaton  A  =  {E,  S,  M},  a  state  Sj  c  S  is  a  persistent  state 
if  it  is  not  a  transient  state. 

For  example,  for  the  automaton  shown  in  Fig.  21,  s^  is  a  transient  state  of  duration 
0;  s2>  a  transient  state  of  duration  1;  By  a  transient  state  of  infinite  duration,  and  s^. 
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Figure  21 


A 


LEVEL  n-1 


LEVEL  n-2 


LEVEL  n-3 


s5>  and  s^  are  persistent  states. 

When  an  automaton  consists  of  transient  states  of  finite  duration,  extra  steps  are 
needed  if  we  want  to  represent  the  automaton  by  the  new  model  discussed  above.  In 
this  new  representation,  suppose  that  k  of  the  latest  input  symbols  are  known;  since 
any  transient  state  of  finite  duration  less  than  k  will  not  appear  in  any  subset  of  states 

at  level  n  -  k  -  1  of  the  tree  of  the  essential  part  of  A^,  no  substate  will  be  assigned 
to  that  state  and  the  representation  is  not  complete.  Figure  22  is  an  example  illustrating 
a  procedure  that  will  complete  the  assignment.  Suppose  that  k  =  2.  Since  s^  is  a  tran¬ 
sient  state  of  duration  0,  s,  does  not  appear  in  any  subset  of  states  at  level  n-3  of  the 

tree  of  the  essential  part  of  A^nh  In  order  to  have  a  substate  assignment  for  s2  as  well, 
we  augment  the  automaton  by  adding  two  more  transient  states  as  in  Fig.  23  so  that  s^ 
becomes  a  transient  state  of  duration  2.  Other  than  this  requirement,  these  two  transient 
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states  can  be  added  arbitrarily.  If  we  look  at  the  tree  of  the  essential  part  of  A'”', 
however,  we  discover  that  for  k  =  2  there  will  be  two  substates.  If  the  transitions  from 
the  two  added  transient  states  are  such  that  s2  is  put  into  the  set  Sj  or  s^  at  level  n-3, 
there  still  will  be  only  two  substates  for  the  augmented  automaton.  Here,  we  choose 
to  put  s2  into  the  set  Sj .  Therefore,  for  the  transient  states  s^  and  s^,  M(s^,  00)  = 
M(s^,  0)  s  Sg.  The  other  entries  of  the  transitions  of  s5  and  s^  can  be  any  of  Sj,  s,,, 

Sj,  s4.  A  simple  rule  to  follow  is  to  choose  entries  that  already  appear  in  the  same 
column.  Here,  we  arbitrarily  choose  M(Sg,  1)  =  M(s6,  1)  =  Sj.  The  output  Bymbols  of 
the  transition  from  s,.  and  s^  are  completely  arbitrary.  As  long  as  the  automaton  in 
Fig.  23  does  not  have  s^  or  s^  as  the  initial  state,  the  augmented  automaton  is  equiv¬ 
alent  to  the  original  automaton. 

For  the  duration  of  a  transient  state  we  have  the  following  theorem. 

THEOREM  9:  In  an  automaton  consisting  of  n  states,  any  transient  state  of  finite 
duration  would  have  a  duration  equal  to  or  less  than  n-2. 

PROOF  9:  We  claim  that  any  automaton  has  at  least  one  persistent  state.  Suppose 
that  there  is  an  automaton  whose  states  are  all  transient  states.  Pick  any  arbitrary 
state  s^.  Since  Sj  is  a  transient  state,  by  definition  we  have 

CASE  I:  There  exists  an  input  symbol  v*.  with  M(Sj,  irx)  =  s^,  that  is  such  that  no 
input  sequence  will  lead  s^  to  s^  again. 

CASE  II:  There  exist  an  input  sequence  t  =  lri<r2<r3  ••••  M(s^,  t)  =  s^,  and 

an  input  symbol  <r  ,  with  M(s.,<r  )  =  s,  ,  which  are  such  that  no  input  sequence 

X  J  X  K 

will  lead  sk  to  s^  again.  No  input  sequence  will  lead  s^  to  any  of  s^,  M(si# ffj), 
M(si,o-jO’2)  ...  either;  otherwise  it  would  be  possible  to  lead  s^  to  s^,  which  is 
a  contradiction. 

In  both  cases,  because  s^  is  again  a  transient  state,  this  argument  can  be  repeated. 
Under  the  conclusion  that  once  a  state  has  been  visited,  it  will  never  be  visited  again, 
after  a  finite  number  of  repetitions  of  the  above  argument,  there  will  be  a  state  su  and 
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an  input  symbol  a-  which  are  such  that  M(s  ,  <r  )  can  go  nowhere.  This  is  obviously 

J  U  J 

impossible. 

Suppose  that  there  is  a  transient  state  s^  and  an  input  sequence  t  =  *1*2*3  •  •  •  *n_j 
which  are  such  that  M(s.,  t)  =  s..  The  states  s.,  Mis.,?.),  M(s.,  <r.<r,),  ...  a.,  are  all 
transient  states.  Since  there  are,  at  most,  n-1  transient  states,  at  least  one  of  them 
is  visited  more  than  once.  Therefore,  for  any  positive  integer  N  there  exists  an  input 
sequence  t'  with  L(t')  s>  N,  which  is  such  that  Mfs^,  t1)  =  s. .  s.  is  then  a  transient  state 
of  infinite  duration.  Q.E.D. 

h.  Minimum  Feedback-Loop  Realization  of  an  Automaton 

Figure  24  illustrates  the  general  physical  model  of  an  automaton.  Notice  that  feed¬ 
back  loops  are  needed  to  carry  the  information  about  the  present  state  of  the  automaton. 


Figure  25 
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Thus  the  number  of  feedback  loops  depends  on  the  number  of  states.  Suppose  that  every 
feedback  loop  carries  one  bit  of  information  (0  or  1);  then  the  number  of  feedback  loops 
is  equal  to  flog2  (total  number  of  states)!-  (This  means  the  smallest  integer  that  iB 
greater  than  or  equal  to  log2  (total  number  of  states).) 

Suppose  that  storage  devices  are  available  to  store  the  past  input  symbols.  We  can 
have  a  realization  based  on  the  new  model  of  the  automaton  with  the  number  of  feedback 
loops  equal  to  llog2  (total  number  of  substates )1,  as  shown  in  Fig.  25.  If  we  extend  the 

tree  of  the  essential  part  of  A^n!  to  such  a  level  that  no  further  reduction  of  the  number 
of  substates  is  possible,  the  realization  will  be  a  minimum  feedback-loop  realization. 
Thus,  the  realization  of  an  automaton  having  a  finite  memory  span  m  can  be  realized 
with  no  feedback  loops  but  requires  m  storage  devices  to  store  the  past  input  symbols. 

3.2  MEMORY  SPAN  WITH  RESPECT  TO  THE  INPUT-OUTPUT  SEQUENCE 

Thus  far,  we  have  discussed  the  memory  span  of  an  automaton  with  only  the  input 
sequences  known.  This  will  be  called  the  memory  span  with  respect  to  the  input.  We 
now  want  to  investigate  the  memory  span  with  both  the  input  sequence  and  its  corre¬ 
sponding  output  sequence  available .  For  an  automaton  A  =  {z,  Z,  S,  M,  n},  we  define  a 
function  R  that  is  such  that  for  all  s  C  S,  and  for  all  (<r,  z)  e  Z  X  Z 

{M(b,c)  if  N(s,ff)  =  z 

undefined  ifN(s,«r)*z. 

Since  the  flow  table  of  the  automaton  explicitly  exhibits  the  functional  relations  of  M 
and  N,  we  can  generate  a  table  of  the  function  R  from  the  flow  table,  as  illustrated  in 
Fig.  26,  in  which  the  bar  entries  are  undefined.  We  then  can  consider  the  table  of  the 
function  R  as  the  flow  table  of  an  automaton  Af  =  {z  X  Z,  S,  R}.  The  input  symbols  to 
Ar  are  ordered  pairs  (<r,  z);  some  of  the  transitions  of  Ar  are  impossible,  and  the  output 
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symbols  are  not  of  interest.  If  we  want  to  form  the  product  automata  of  Ar,  we  shall 
write  a  state  like  (s.,— ,  Sj.— ,— )  as  (a.,  Sj)  by  simply  omitting  all  bar  entries,  and  shall 
disregard  a  state  with  all  undefined  entries  like 

An  input-output  sequence  w  is  a  sequence  of  ordered  pairs  (<r,  z)  c  ZX  Z.  The  length 
of  an  input-output  sequence  is  the  number  of  ordered  pairs  in  the  sequence.  Thus  we 
can  extend  the  definition  of  R  as  follows 

{R(R(s,  (<r,  z)),  w)  if  R(s,  (<r,  z))  is  defined 

undefined  if  R{s,  (<r,  z))  is  undefined. 

DEFINITION  1 3:  Rls-.w^  and  Rfs^,  w^)  are  compatible  and  will  be  denoted  by 
R(s.,  w. )  +  R(s  ,  w_),  if  (a)  both  R(s.,  w. )  and  R(s  ,  w_)  are  defined  and  have  the  same 

1*  J  t  11  J  6 

final  state,  or  (b)  either  one  or  both  of  R(s.,  w.)  and  R(s.,  w.)  are  undefined. 

11  J  6 

It  follows  that  R(si(  Wj)  and  R(Sj,w2)  are  incompatible  if  both  R(sit  Wj)and  R(Sj,  w2> 
are  defined  and  are  different. 

DEFINITION  14:  An  automaton  A  =  {z,  Z,  S,  M,  N}  has  a  finite  memory  span  m  with 
respect  to  the  input-output  sequence  if  and  only  if  (a)  R(si#  w)  *  R(Sj,  w)  *or  8j»  sj 
S  and  for  any  w  with  L(w)  >m  +  1,  and  (b)  there  exist  Sj  €  S,  and  w  with  L(w)  =  m 
which  are  such  that  R(s^.  w)  and  R(Sj,  w)  are  incompatible. 

DEFINITION  1 5:  An  automaton  A  =  {z,  Z,  S,  M,  N}  has  an  infinite  memory  span  with 
respect  to  the  input-output  sequence  if  and  only  if  for  any  given  integer  N  there  exist 
s^,  s  (S  and  w  with  L(w)  J  N  which  are  such  that  R(b^,  w)  and  R(Sj,  w)  are  incompat¬ 
ible. 

a.  Test  for  the  Memory  Span  with  Respect  to  the  Input-Output  Sequence 

DEFINITION  16:  Two  states  s i  and  Sj  have  a  unique  final  state  with  respect  to  the 
input-output  sequence  if  R(Sj,  w)  *  R(s^,  w)  for  any  input-output  sequence  w  with  L(w)  > 

K,  where  K  is  a  specific  constant  for  the  automaton. 

From  Definition  16,  it  follows  that  two  states  s^  and  Sj  will  not  have  a  unique  final 
state  with  respect  to  the  input-output  sequence  if,  for  any  integer  N,  there  exists  an 
input-output  sequence  w,  with  L(w)  »  N,  which  is  such  that  R(s^,  w)  and  R(Sj,  w)  are 
incompatible. 

THEOREM  10:  An  automaton  will  have  a  finite  memory  span  with  respect  to  the 
input-output  sequence  if  and  only  if  every  pair  of  its  internal  states  has  a  unique  final 
state  with  respect  to  the  input-output  sequence. 

PROOF  10:  First,  we  prove  the  necessity.  Suppose  that  there  are  two  states  s^ 
and  Sj  that  do  not  have  a  unique  final  state  with  respect  to  the  input-output  sequence. 

That  is,  there  exists  (<r,  z)  €  Z  X  Z  that  is  such  that  RiSj,  (<r,  z))  and  R(Sj,  (a,  z))  are 
defined  and  do  not  have  a  unique  final  state  with  respect  to  the  input-output  sequence. 

By  repeating  this  argument  on  R(Sj,  (<r,  z))  and  R(Sj,  (<r,  z)),  and  so  on,  it  can  be  shown 
that  for  any  given  integer  N  there  exists  w  with  L(w)  a  N  that  is  such  that  R(s^,  w)  and 
R(Sj,  w)  are  incompatible.  The  automaton  will  then  have  an  infinite  memory  span  with 
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respect  to  the  input -output  sequence. 

Second,  we  prove  the  sufficiency.  We  claim  that  if  two  states  s.  and  Sj  have  a  unique 

final  state  with  respect  to  the  input-output  sequence,  then  R(s,,  w)  *  R(s.,  w)  for  any  w 

l,\  * 

with  L(w)  5s  n(n-l)/2.  This  fact  can  be  seen  by  forming  A*;  • .  If  the  automaton  starts 
from  {s.,  s  }  and  terminates  at  any  compound  state  after  n(n-l)/2  steps  of  transition, 

1  J  {2} 

then  there  must  be  a  loop  around  a  certain  compound  state,  since  A£  1  consists  of  only 
n(n-l)/2  compound  states.  This  is  a  contradiction  to  the  assumption  that  s^  and  s^  have 
a  unique  final  state.  Therefore,  for  any  w  with  L(w)  »n(n-l)/2,  each  of  R(s^,  w), 
R(sz,  w),  ....  R(sn,  w)  will  either  be  undefined  or  equal  to  the  same  final  state.  Q.E.  D. 

COROLLARY  1:  If  an  automaton  has  a  finite  memory  span  m  with  respect  to  the 
input-output  sequence,  then  m  *[n(n-l)/2]  -  1. 

#From  Theorem  10,  we  can  test  whether  or  not  an  automaton  has  a  finite  memory 
span  with  respect  to  the  input-output  sequence  by  checking  whether  or  not  all  pairs  of 
states  have  a  unique  final  state  with  respect  to  the  input-output  sequence.  Notice  that 
the  compatibility  relation  of  the  function  R  is  not  transitive.  That  is,  if  R(s.,w)  *  R(s^,w) 
and  R(s .,  w)  *  R(s.  ,  w),  it  is  not  necessary  that  R(s.,  w)  *  R(s.  ,  w)  because  R(s.,  w)  may 

J  K  1  K  j 

be  undefined.  A  systematic  procedure  to  carry  out  this  test  is  illustrated  in  Fig.  27. 

First,  we  generate  the  table  of  the  function  R,  and  then  form  a  'checking  table"  like 
that  shown  in  Fig.  28a.  A  cross  is  entered  if  a  state  s^  (in  the  row)  and  a  state  s^  (in 
the  column)  have  a  unique  final  state  with  respect  to  the  input-output  sequence.  The 
diagonal  entries  will  be  crossed  off  at  the  beginning,  as  shown  in  Fig.  28a,  because  R(s^, 
(<r,  z))  *  R(s.,  ((T,  z))  for  all  (<r,  z)  €  2X  Z.  We  then  go  through  all  pairs  of  states  and 
examine  them  one  by  one.  For  example,  we  start  with  Sj,  s2>  Because  R(Sj,  (0,  0))  = 
s^  and  R(s2,  (0,  0))  =  sL  and  s4  and  Sj  still  have  not  been  shown  to  have  a  unique  final 
state  with  respect  to  the  input-output  sequence  (no  cross  mark  in  the  Sj,  s4  entry),  Sj 
and  s2  might  not  have  a  unique  final  state  with  respect  to  the  input-output  sequence. 
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Figure  27 
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(a) 


(b) 

Figure  28 


(e) 


Examination  of  the  pair  Sj  and  s^  shows  that  the  entry  corresponding  to  Sj,  s  ^  in  the 
table  should  be  crossed  off.  So  should  the  entries  corresponding  to  Sj,  s4;  s y  By  By 
s^  . . .  .  After  the  first  pass,  we  have  the  entries  shown  in  Fig.  28b.  We  then  start  to 
test  again  those  pairs  whose  corresponding  entries  in  the  table  are  still  unchecked.  The 
pair  s^  and  now  should  be  checked  off  as  having  a  unique  final  state  with  respect  to 
the  input-output  sequence  because  Sj ,  s^  has  been  checked  already.  So  should  the  pairs 
Sj,  sE  and  By  s,..  We  finally  have  the  table  in  Fig.  28c.  Since  all  entries  in  the  checking 
table  are  checked,  we  know  that  the  automaton  has  a  finite  memory  span  with  respect 
to  the  input-output  sequence;  otherwise,  the  automaton  would  have  an  infinite  memory 
span  with  respect  to  the  input-output  sequence. 


b.  Bounds  on  the  Memory  Span 

• 

Corollary  1  places  an  upper  bound  on  the  values  of  the  memory  span  with  respect 
to  the  input-output  sequence  ■  Theorem  1 1  provides  a  lower  bouncer 

THEOREM  11:  If  a  strongly  connected  automaton  consisting  of  n  states  has  a  finite 
memory  span  m  with  respect  to  the  input-output  sequence,  then  (ap)m+1  »  n,  where  a 
is  the  number  of  input  symbols  and  p  is  the  number  of  output  symbols. 

PROOF  11:  Since  the  automaton  has  a  finite  memory  span  m  with  respect  to  the 

input-output  sequence,  for  all  s  in  S  and  any  input -output  sequence  w  of  length  m+1, 

R(s,  w)  would  either  be  undefined  or  would  have  the  same  final  state.  There  are  (cp)m+1 

different  input-output  sequences  of  length  m+1 .  Therefore,  at  most,  (aP)m+*  states 

could  be  the  possible  final  state  after  m+1  steps  of  transition  from  all  n  possible  initial 

states.  Suppose  that  (ap)m+1  <  n.  There  must  be  at  least  one  state,  say  s.  ,  that  is  not 

included  in  these  (ap)  final  states.  Because  the  automaton  is  assumed  to  be 

strongly  connected,  however,  there  exiBt  an  input  sequence  t  of  length  m+1  and  an 

initial  state  s.  which  are  such  that  M(s.>t)  =  s.  .  These  imply  that  there  exists  w 
J  J  K 

that  is  such  that  R(Bj,  w)  =  s^,  a  contradiction  to  our  assumption. 

Q.E.D. 
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c.  Procedures  to  Determine  the  Value  of  the  Memory  Span 

After  an  automaton  is  found  to  have  a  finite  memory  span  with  respect  to  the  input- 
output  sequence,  the  value  of  the  memory  span  can  be  found  by  constructing  the  tree  of 

the  essential  part  of  For  example,  the  memory  span  with  respect  to  the  input- 

output  sequence  of  the  automaton  in  Fig.  27  can  be  found  to  be  2.  The  tree  of  the  essen¬ 
tial  part  of  A^  is  shown  in  Fig.  29.  The  memory  span  can  also  be  found  by  slightly 
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modifying  the  construction  of  the  checking  table.  Instead  of  checking  off  pairs  of  states 
having  a  unique  final  state  with  a  cross,  we  shall  enter  the  numerals  1,  2  ...  to  indicate 
that  they  are  checked  off  in  the  first,  second,  or  subsequent  pass.  (Zeros  indicate 
entries  checked  off  by  definition.)  For  example,  the  checking  table  in  Fig.  28  is  recon¬ 
structed  and  shown  in  Fig.  30.  In  Fig.  30a,  O' s  are  entered  in  the  diagonal  boxes.  In 
Fig.  30b  pairs  of  stateB  are  checked  off  in  the  first  pass.  Figure  30c  shows  the  final 
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form  of  the  checking  table.  Since  the  highest  count  is  3  in  the  table,  the  memory  span 
is  3  -  1  =  2.  (The  memory  span  always  equals  the  highest  count  minus  one.)  Notice 
that  the  box  corresponding  to  s^,  s ^  is  crossed  off  in  the  second  pass  instead  of  the  first 
because  the  pair  s^  and  s^  cannot  be  crossed  off  until  the  pair  s2  and  s^  is  crossed  off. 
However,  the  pair  s2  and  s ,  is  crossed  off  in  the  first  pass.  A  slight  reflection  on  the 
basic  idea  of  the  construction  of  the  checking  table  will  indicate  that  this  procedure 
always  works. 

d.  Extension  of  the  Discussions  of  the  Input  to  the  Input-Output  Sequence 

As  we  can  realize  immediately,  complete  or  partial  information  about  the  present 
state  of  an  automaton  can  be  obtained  from  the  past  input  and  output  sequences.  The 

discussions  on  the  ambiguity  of  the  present  state,  the  tree  of  the  essential  part  of  A^, 
and  a  new  model  for  the  automaton  in  the  case  of  the  memory  span  with  respect  to  the 
input  can  be  extended  to  the  case  of  the  memory  span  with  respect  to  the  input-output 
sequence  and  will  not  be  repeated  here. 

3.3  MEMORY  SPAN  WITH  RESPECT  TO  THE  OUTPUT 


It  seems  natural  to  ask  about  the  memory  span  of  an  automaton  with  respect  to  its 
output  sequences.  Although  some  of  the  ideas  developed  thus  far  can  be  extended,  there 
are  some  peculiar  differences  that  must  be  taken  into  account.  For  an  automaton  A  = 

{2,  Z,  S,  M,  N},  we  define  a  function  Q.  For  all  s  €  S  and  all  z  €  Z, 

fM(s,<r),  for  all  <r  that  are  such  that  N(s,  <r)  =  z 

Q(s,z) 

(undefined,  if  there  is  no  <r  that  is  such  that  N(s,  <r)  =  z. 


Q(s,  z)  may  be  multivalued  because  when  Q(s,  z)  is  defined  there  may  exist  more  than 
one  v  that  is  such  that  N(s,<r)  =  z.  Let  y  =  ZjZ2z3  . . .  denote  a  sequence  of  output  sym¬ 
bols.  The  definition  of  the  function  Q  can  be  extended  to 


fQ(Q(s,  z),y),  if  Q(s,  z)  is  defined  and  is  single-valued 


Q(Q(s,  z),y)  =  {Q(M(s,(r1),y),Q(M(s,<r2),y).  . .}, 


Q(s,  zy)  =•< 


if  Q(s,  z)  is  defined  and  is  multivalued,  i.e., 
Q(s,  z)  =  {Mts.ffj),  M(s,o-z). . .} 


undefined,  if  Q(s,  z)  is  undefined. 


DEFINITION  17:  Q(a^,  y^)  and  Q(Sj,  y2)  are  compatible  and  will  be  denoted  by  Q(Sj, 
yt)  *  Q(Sy  y2),  if  (a)  both  QfSj,  yj)  and  Q(s^,  y2)  arc  single- valued  and  equal  to  the  same 
next  state  or  (b)  either  QfSj,  yj )  or  Q(s .,  y2)  is  undefined  and  the  other  is  single¬ 
valued  or  (c)  both  Q(Sj,  yt )  and  Q(Sj,  y2)  are  undefined. 

Notice  that  Q(Sj,  y^  *  Q(Sj,  y^ )  is  not  necessarily  true  because  Q(Sj,  y3 )  may  be  multi¬ 
valued,  and  by  Definition  17  all  multiple  values  are  automatically  incompatible. 
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As  an  example,  for  the  table  of  the  function  Q  shown  in  Fig.  31,  we  have 

Q(Sj,  1)  *Q(s2,  1) 

Q(Sj,  1)  *Q(s4,  1) 

and  the  fact  that 

Q(Sj,  1)  andQ(s3, 1)' 

►are  incompatible. 

Q(Sj,  0)  and  Q(s2,  0) 

- 

If  the  function  Q  of  an  automaton  is  always  defined  and  is  single-valued,  it  can  be  con¬ 
sidered  the  function  M  of  some  other  automaton,  and  all  of  our  previous  discussions 
of  the  memory  span  with  respect  to  the  input  can  be  applied.  If  the  function  Q  is  always 
single-valued  when  defined,  it  can  be  considered  the  function  E  of  some  other  automaton, 
and  all  of  our  previous  discussions  of  the  memory  span  with  respect  to  the  input-output 
sequence  can  be  applied.  For  an  example,  see  Fig.  32. 

In  general,  the  function  Q  might  be  multivalued.  We  shall  now  study  this  general 
case. 

DEFINITION  18:  For  an  output  sequence  y,  a  set  of  states  s.,  Sj,  s^  . . .  has  a  unique 
intermediate  state  if  Q(su<  yj)  *  Q(sv<  yj)  for  all  su  and  sy  in  the  set  and  a  prefix  por¬ 
tion  of  y,  say  yt  (y=y,y2). 

DEFINITION  1 9:  An  automaton  A  =  {2,  Z,  S,  M,  N}  has  a  finite  memory  span  m  with 
respect  to  the  output  if  and  only  if  (a)  for  any  output  sequence  whose  length  is  equal  to 
or  larger  than  m+1,  the  set  of  all  states  s^ ,  s2>  ...  sn  has  a  unique  intermediate  state, 
and  (b)  there  exist  a  pair  of  states  8.  and  Sj  and  an  output  sequence  whose  length  is  equal 
to  m,  for  which  si  and  Sj  do  not  have  a  unique  intermediate  state. 

The  reason  that  we  have  to  suggest  such  a  definition,  which  is  somewhat  different 
from  that  for  the  memory  spans  with  respect  to  the  input  and  with  respect  to  the  input- 
output  sequence,  is  the  fact  that  the  function  Q  might  be  multivalued.  Thus  Q(s^,  y})  * 
Q(s2,y1)  does  not  guarantee  that  Q(s.,  yjz)  *  Q(s2,  yjZ).  We  can  say,  however,  that  for 
an  automaton  having  a  finite  memory  span  m  with  respect  to  the  output,  within  m+1  steps 
of  transition  corresponding  to  any  output  sequence  y,  there  must  be  at  least  one  time 
period  during  which  the  automaton  is  unambiguously  in  a  certain  state,  regardless  of 
the  possible  initial  state. 

DEFINITION  20:  An  automaton  A  =  {z,  Z,  S,  M,  N}  has  an  infinite  memory  span  with 
respect  to  the  output  if  and  only  if  for  any  given  integer  N,  there  exist  a  pair  of  states 
s |  and  Sj  and  an  output  sequence  whose  length  is  equal  to  or  larger  than  N,  for  which 
8^  and  Sj  do  not  have  a  unique  intermediate  state. 

a.  Test  for  the  Memory  Span  with  Respect  to  the  Output 

•  DEFINITION  21:  Two  states  s.  and  Sj  have  a  unique  next  state  with  respect  to 
the  output  if  for  all  z  e  Z  (a)  Q(s.,  z)  *  Q(Sj,  z),  or  (b)  both  Q(Sj,  z)  and  Q(Sj,  z)  are 
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single-valued  and  have  a  unique  next  state  with  respect  to  the  output  ,  or  (c)  when  either 
or  both  of  Q(s.,  z)  and  Q(Sj,  z)  are  multivalued,  any  pair  of  the  possible  next  states  will 
have  a  unique  next  state  with  respect  to  the  output.  (For  example,  if  QfSj,  z)  =  s^,  sm 
and  Q(Sj,  z)  is  undefined,  then  sk  and  sm  should  have  a  unique  next  state  with  respect 
to  the  output.  If  Qfs^  z)  =  s^,  sm<  Q(Sj,  *)  =  sp,  s^,  then  any  pair  of  sk<  sm;  s^,  sp; 
s^,  s^;  sm<  sp;  sm<  s^;  sp,  s^  should  have  a  unique  next  state  with  respect  to  the  out¬ 
put.) 


DEFINITION  22:  A  state  a.  has  a  unique  next  state  with  respect  to  the  output,  if,  for 
all  z  e  Z,  (a)  Q(s. ,  z)  is  undefined  or  is  single-valued,  or  (b)  when  Q(s.,  z)  is  defined 
and  is  multivalued,  any  pair  of  the  possible  next  states  will  have  a  unique  next  state  with 
respect  to  the  output. 

Our  test  is  based  on  a  theorem  that,  in  turn,  is  based  on  the  following  lemmas. 
LEMMA  4:  For  a  set  of  states  s^,  s^,  s^,  sm  . . .  and  for  an  output  sequence  y,  if 
all  pairs  of  states  in  this  set  have  a  unique  intermediate  state,  that  is,  if  QlSj,  yj  )*Q(s .,  y^ 

Q (Sj,  y2)  *  Q< v  y2*  •  •  ■  ■  Q<sj'  y3*  *  Q(sk*  y3)  •  •  • '  where  y  =  y^i  =  y2y2  =  y3y'3 . 


then  Q(s  ,  y  )  *  Q(s  ,  y  )  for  all  s  and  s  in  the  set,  where  y  is  the  longest  sequence 

U  X  V  X  U  V  X 

among  y,,  y2>  y3  . . .  . 

PROOF  OF  LEMMA  4:  Suppose  that  the  pair  s^  and  sm  corresponds  to  the  sequence 

yx  11134  is  8uch  that  *^sk'  yx^  *  Q(8m*  yx)-  If  both  QUk,  yx>  and  Q(sm'  yx^  are  undefined< 

we  can  pick  the  pair  s^  and  s^  corresponding  to  the  next  longest  sequence  y1  and  use  the 

argument  that  follows.  Assume  that  at  least  one  of  and  Q(sm<  yx)  I®  defined 

and  is  equal  to  s.  For  any  state  s.,  we  have  Q(s.,y  )  *Q(s.,y  )  and  Q(s.,y.)* 

Q(Sm.  yb)-  where  ya  and  yfa  are  prefix  portions  of  y.  Either  one  or  both  of  Q(sk>  ya> 

andQ(sm>  yfa)  must  be  defined,  otherwise,  Q(sk,  yx)  and  Q<8m*yx)  will  be  undefined. 

Assume  that  Q(s.  ,y  )  =  s,  .  (The  case  that  Q(s.,y)  is  undefined  while  Q(s  ,  y,  )  is 

defined  or  the  case  that  both  Q(s.  ,y„)  and  Q(s_,y.  )  are  defined  can  be  proved  in  a  simi- 

K  a  m  D 

lar  manner.)  If  Q(s.,y  )  is  undefined,  we  immediately  have  Q(s.,y  )  *  Q(s,  ,y  )  and 
i  a  l  x  K  x 

Q(s..y  )  *  Q(srr,.yv)  because  y  is  a  prefix  portion  of  y  .  If  Q(s.,y  )  =  s  .  and  since 
a  x  in  x  a  x  l  a  u  . 

we  can  write  yx  =  y#y^  ,  then  Q(sk,  yx)  =  Q(sk>  yfty^ )  =  Q(su,  y^)  =  Q(sm>  yx)  =  sw-  There¬ 
fore  Q(s.,  y  )  is  either  undefined  or  etjual  to  s  ,  and  we  have  Q(s.,  y  )  *  Q(s,  ,  y  )  and 
Q<si,yx)  *  Qtejn'yjc)1  Similar  argument  can  be  applied  to  all  states  in  the  set.  Q.E.D. 

LEMMA  5:  In  an  automaton  consisting  of  n  states,  if  any  pair  of  states  has  a  unique 
next  state  with  respect  to  the  output,  then  the  set  of  all  n  states  will  have  a  unique  inter¬ 
mediate  state  for  any  output  sequence  of  a  length  that  is  equal  to  or  larger  than  n(n-l)/2. 

PROOF  OF  LEMMA  5:  By  Lemma  4,  we  have  only  to  prove  that  any  pair  of  states 
Sj  and  a j  will  have  a  unique  intermediate  state  for  any  output  sequence  of  a  length  that 
is  equal  to  or  larger  than  n(n-l)/2.  Let  {Q(Sj,  z)  UQ(Sj,  z)}  denote  the  set  of  all  possible 
values  of  Q(s.,  z)  and  Q(Sj,  z).  By  the  definition  of  two  states  having  a  unique  next  state, 
we  see  that  if  {3(s.,  z)  UQ(s^,  z)}  consists  of  only  one  state,  the  lemma  holds.  If,  how¬ 
ever,  {Q(si(  z)  UQ(Sj,  z)}  consists  of  two  or  more  states,  say  su,  sv>  s  ,  sx  . . . ,  we  can 
group  su,  sy,  sw,  sx  . . .  into  all  possible  pairs,  say  {su>  sy},  {s^  sw)  . . .  {sv,  sw> - 
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These  pairs  of  states  must  also  have  a  unique  next  state,  and  we  can  repeat  the  above¬ 
given  argument  to  examine  the  value  of  {Q(su,  z)  UQ(sy,  z)},  {Q(bu>  z)  UQ(sw»  z)}  . . .  {Q(sv> 
z)  Uq(s  ,  z)}  . . .  .  Since  there  are  n(n-l)/2  pairs  of  states,  s,  and  s.  should  terminate 
at  a  unique  intermediate  state  after,  at  most,  n(n-l)/2  steps  of  transition.  Otherwise, 

s  and  s,  will  not  have  a  unique  next  state  with  respect  to  the  output,  in  contradiction 
i  J 

to  the  assumption.  Q.E.D. 

THEOREM  1 2:  An  automaton  will  have  a  finite  memory  span  with  respect  to  the  out¬ 
put  if  and  only  if  all  pairs  of  states  have  a  unique  next  state  with  respect  to  the  output. 

PROOF  12:  Theorem  12  follows  immediately  from  Lemmas  4  and  5. 

COROLLARY  2:  If  an  automaton  has  a  finite  memory  span  m  with  respect  to  the 
output,  m  <  [n(n-l)/2]  -  1. 

From  Theorem  12,  we  have  a  means  for  checking  the  memory  span  of  an  automaton 
with  respect  to  the  output.  The  procedure  is  very  similar  to  the  one  employed  to  check 
the  memory  span  with  respect  to  the  input -output  sequence.  As  an  example,  the  test 
procedure,  applied  to  the  automaton  shown  in  Fig.  33,  is  shown  in  Fig.  34.  From  the 
functions  M  and  N  of  A  we  form  the  table  of  the  function  Q.  We  check  each  individual 
state  to  see  whether  or  not  it  has  a  unique  next  state.  States  s,,  s^,  s^,  s^.,  sA  do,  and 
we  do  not  know  whether  Sj  does  or  not  at  this  moment  because  Q(Sj ,  0)  =  s2,  By  as 
shown  in  Fig.  34a.  Then  we  check  all  pairs  of  states  to  determine  whether  or  not  they 
have  a  unique  next  state.  We  have  the  table  shown  in  Fig.  34b  after  the  first  pass  and 
that  of  Fig.  34c  after  the  second  pass.  Because  the  pair  s2  and  s}  has  been  checked,  Sj 
now  can  be  checked  as  having  a  unique  next  state  with  respect  to  the  output.  The  pairs 
(Sj.s^,  ( : . ,  s ,)  ...  (Sj,  sfc)  can  then  be  checked  as  shown  in  Fig.  34d.  Another  pass 
will  fill  up  all  of  the  entries  in  the  checking  table,  and  we  know  that  the  automaton  has  a 
finite  memory  span  with  respect  to  the  output. 

We  can  form  the  tree  of  the  essential  part  of  A‘ni,  as  shown  in  Fig.  35.  We  see  that 
the  automaton  has  a  finite  memory  span  3  with  respect  to  the  output.  Notice  that,  in 

forming  the  tree,  we  stop  at  any  branch  if  a  set 


containing  a  single  state  is  encountered  along  that 
branch.  Also,  notice  that  our  definition  of  finite 
memory  span  with  respect  to  the  output  (Defini¬ 
tion  18)  guarantees  that  there  is  a  unique  inter¬ 
mediate  state  for  any  output  sequence  of  length  4, 
but  not  necessarily  a  unique  final  state.  For 
example,  an  output  sequence  0110  will  not  give  a 
unique  final  state  (both  s2  and  s}  are  possible). 

The  value  of  the  memory  span  with  respect  to 
the  output  can  also  be  found  by  entering  numerals 
instead  of  crosses  in  the  checking  table.  This 
procedure  is  identical  with  that  shown  for  finding 


Figure  36 


the  value  of  the  memory  span  with  respect  to  the 
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input-output  sequence.  (See  Fig.  30.)  The  checking  table  of  the  automaton  in  Fig.  33, 
which  has  a  memory  span  of  3  with  respect  to  the  output,  is  shown  in  Fig.  36. 

3.4  EXTENSION  TO  INPUT  AND  OUTPUT  SEQUENCES  OF  UNEQUAL  LENGTH 

We  shall  investigate  the  determination  of  the  present  state  of  an  automaton  with  p 
of  the  past  input  symbols  and  q  of  the  past  output  symbols  known,  for  p  *  q  (for  p  =  q, 
see  the  memory  span  with  respect  to  the  input-output  sequence).  We  find  that  for  a  given 
automaton,  p  and  q  do  not  have  fixed  values.  The  techniques  developed  thus  far  can  be 
employed  to  find  the  possible  p-q  values. 

We  use  the  automaton  of  Fig.  37  as  an  example  and  form  the  checking  table  for  A^ 
as  shown  in  Fig.  38a.  To  find  the  possible  p-q  values  with  p  larger  than  q,  we  form 

the  tree  of  the  essential  part  of  A^,  as  shown  in  Fig.  38b.  For  p  =  q,  we  examine  the 

set  of  states  at  level  n-1  in  the  tree  of  the  essential  part  of  A^nK  The  value  of  q  will 
be  equal  to  the  largest  number  in  the  checking  table  which  corresponds  to  pairs  of  states 
that  are  in  this  set.  In  Fig.  38,  q  =  4  because  of  the  pair  Sj  and  s^-  (We  can  consider 
any  unchecked  box  in  the  checking  table  as  having  an  entry  that  is  equal  to  infinity.)  For 
p  =  q  +  1,  we  examine  all  sets  of  states  at  level  n-2.  Because  of  the  pair"’ of  states  Sj 
and  s4  in  the  subset  {s^,  Sy  s4},  q  =  3,  that  is,  the  present  state  of  the  automaton  can  be 
determined  uniquely  when  four  of  the  latest  input  symbols  and  three  of  the  latest  output 
symbols  are  known.  For  p  =  q  +  2,  we  examine  all  of  the  sets  of  states  at  level  n-3.  It 
turns  out  that  q  =  2.  Because  the  subset  {s^,  s4}  will  occur  in  all  subsequent  levels  of 
the  tree,  the  value  of  q  will  be  2  at  all  subsequent  levels  of  the  tree. 

To  find  the  possible  q-p  values  with  q  larger  than  p,  we  shall  go  through  the  same 
procedure  as  above,  except  that  we  shall  form  the  tree  of  the  essential  part  of 

A^nL  The  tree  is  shown  in  Fig.  39.  For  q  =  p,  p  =  3.  For  q  =  p  +  1,  p=3  because 
of  the  subset  {s( .  s2>  s3}.  For  q  =  p  +  2,  p  =  2  because  of  the  subsets  {s2>  s^}  and  {sj,  s^}. 

In  general,  we  shall  never  extend  the  tree  of  the  essential  part  of  A^  or  of  A^ 
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beyond  n(n-l)/2  levels,  where  n  Is  the  number  of  states  of  the  automaton.  Because  a 
branch  of  length  n(n-l)/2  will  certainly  include  all  possible  pairs  of  states  in  the  n(n-l)/2 
subsets  of  states  along  that  branch,  further  extension  of  that  branch  will  never  decrease 
the  value  of  q  (for  p  >  q)  or  p  (for  q  >  p). 

a.  Relation  between  the  Value  of  p  -  q  and  q  (or  q  -  p  and  p) 

We  want  to  show  that  the  value  of  q  is  nonincreasing  as  we  increase  the  value  of  p  -  q 

by  extending  the  branches  of  the  tree  of  the  essential  part  of  for  p  >  q.  The  same 
result  is  true  for  q  >  p,  where  p  is  nonincreasing  for  increasing  value  of  q  -  p.  We 
prove  this  by  induction.  Figure  40  shows  the  top  levels  of  the  tree  of  the  essential  part 

of  S  is  the  set  of  all  of  the  states  of  the  automaton,  {a},  {b}  {c},  {d},  {e},  and 

{f}  are  subsets  of  states.  Of  course,  {a}  and  {b}  are  subsets  of  {s}.  Since  M^({s},  0)  = 

{a},  and  M  0)  =  {c},  and  since  {a}  is  a  subset  of  {s},  {c}  is  a  subset  of  {a}.  Similarly 

{d}  is  a  subset  of  {b},  {e}  is  a  subset  of  {a}  and  {f}  is  a  subset  of  {b}.  For  levels  n-k, 
n  -  k  -  1,  and  n  -  k  -  2  as  shown  in  Fig.  41,  suppose  that  every  subset  of  states  in  level 
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n  -  k  -  1  is  a  subset  of  some  subset  of  states  in  level  n-k.  For  any  subset  of  states  in 

level  n  -  k  -  2,  say  {z},  M^n^({t},  1)  =  {z}.  By  assumption,  {t}  is  a  subset  of  a  subset  of 

states  in  level  n-k,  say  {m}.  Since  M  1)  =  {v},  then  {z}  is  a  subset  of  {v}.  The 

result  is  the  fact  that  all  subsets  of  states  in  level  n  -  k  -  2  of  the  tree  of  the  essential 

part  of  are  subsets  of  subsets  of  states  in  level  n  -  k  -  1 .  This  immediately  leads 
to  the  conclusion  that  the  value  of  q  corresponding  to  subsets  of  states  in  level  n  -  k  -  2 
will  not  be  larger  than  that  corresponding  to  subsets  of  states  in  level  n  -  k  -  1 . 
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IV.  SYNCHRONIZATION  OF  AUTOMATA 


4.1  INTRODUCTION 

In  an  automaton  A  *  {z,S,  M},  a  set  of  states  s^,  s.,  s^  .  .  .  is  said  to  be  synchro- 
nizable  with  a  state  su  if  there  exists  an  input  sequence  t  of  finite  length  which  is  such 
that  M(s.,t)  *  M(s.,t)  >  M(s.  ,  t)  =  .  .  .  *  s  .  The  input  sequence  t  is  called  the  synchro- 

l  j  K  U 

nizing  sequence  that  synchronizes  this  set  of  states  with  su  or,  briefly,  the  synchro¬ 
nizing  sequence  with  s  .  More  generally,  a  set  of  states  s.,  s.,  s.  . . .  is  said  to  be 

U  1  J  K 

synchronizable  if  there  exists  an  input  sequence  t  of  finite  length  which  is  such  that 
M(s.,t)  »  M(s.,t)  =  M(s.  ,t)  =  . . .  .  The  input  sequence  t  is  called  the  synchronizing 

1  J  K 

sequence  that  synchronizes  this  set  of  states  or,  briefly,  the  synchronizing  sequence. 

THEOREM  13:  In  a  strongly  connected  automaton,  a  set  of  synchronizable  states 
is  synchronizable  with  any  specific  state  su- 

PROOF  13:  Let  s.,  s.,  s,  .  .  .  be  the  set  of  states  which  is  synchronizable  by  the 

1  J  K 

input  sequence  t.  It  follows  that  M(s.,t)  =  M(s.,t)  =  M(s.,t)  =  .  .  .  =8  ,  where  8  is 

1  J  K  V  V 

some  state  of  the  automaton.  Since  the  automaton  is  strongly  connected,  there  exists 
an  input  sequence  t*  that  is  such  that  M(sv,t')  =  su-  Input  sequence  tt ’  is,  then,  the 
synchronizing  sequence  that  synchronizes  this  set  of  states  with  s  .  Q.  E.  D. 

Furthermore,  we  say  that  an  automaton  is  synchronizable  (with  a  state  su>  if  the  set 
of  all  states  is  synchronizable  (with  s  ).  We  have  the  following  theorem. 

THEOREM  14:  An  automaton  cannot  be  synchronized  with  a  transient  state. 

PROOF  14:  No  input  sequence  will  lead  a  persistent  state  to  a  transient  state.  By 
Theorem  9,  however,  any  automaton  has  at  least  one  persistent  state.  Q.  E.  D. 

4.2  RELATION  TO  THE  Ap  OR  A^  AUTOMATON 


To  investigate  the  synchronizability  of  a  set  of  p  states  in  an  automaton  A,  we  investi¬ 
gate  the  Ap  or  the  A^  automaton.  It  is  rather  obvious  that  a  set  of  p  states  s.,  s.,  s, 

p  1  J  K 

...  is  synchronizable  with  a  state  su  if  and  only  if  in  there  exists  an  input  sequence 

t  that  is  such  that  M^JSj,  s^,  s^. .  .),t)  =  (su>  8U>  8U- •  ■)>  or  in  A^,  s^,  sk. . .},  t)  = 

{su}.  Thus  we  have  a  way  to  check  the  synchronizability  of  a  set  of  states  and  to  find 
the  corresponding  synchronizing  sequence.  As  an  example,  for  the  automaton  shown  in 
Fig.  42,  010  is  a  synchronizing  sequence  that  will  synchronize  Sj  and  s^  with  s 2;  but 
there  is  no  synchronizing  sequence  that  will  synchronize  Sj  and  s^  with  Sj  or  with  8^. 

We  have  the  following  procedure  to  check  systematically  the  synchronizability  of  a 
set  of  p  states  and,  at  the  same  time,  to  find  the  shortest  possible  synchronizing 
sequence: 

(a)  Form  the  flow  table  of  the  automaton  A^PL 

(b)  Put  the  state  {s.,  s^. . .}  corresponding  to  the  set  of  states  to  be  synchronized  at 
the  top  of  a  tree.  Cross  off  all  appearances  of  the  state  {s.,  s^.  . .}  in  the  flow  table. 

(c)  Extend  the  tree  by  listing  all  of  the  states  that  still  have  not  been  crossed  off  in 
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the  now  table  and  that  can  be  reached  from  states  already  in  the  tree  through  one  step 
of  transition.  Then  cross  off  all  appearances  of  these  states  in  the  flow  table. 

(d)  Repeat  step  (c),  either  until  a  specific  simple  state  {s^}  (or  any  simple  state 
{8y}  in  the  case  of  synchronizing  a  set  of  states)  is  reached  or  until  no  further  repetition 
is  possible  (that  is,  until  all  of  the  states  have  been  crossed  off  which  can  be  reached 
from  states  already  in  the  tree  through  one  step  of  transition). 

Figure  43  illustrates  this  test  procedure.  In  order  to  check  the  synchronizability 

of  Sj  and  Sj,  we  form  the  flow  table  of  and  grow  a  tree,  starting  from  {sj,  Sj}. 
All  appearances  of  {s^  s^}  in  the  flow  table  are  crossed  off  first  (single  underline  in 
Fig.  43).  Since  one  step  of  transition  from  {sj.Sj}  will  lead  to  {sj,s2}  and  {s^Sj}, 
their  appearances  in  the  flow  table  are  crossed  off  accordingly  (double  underline  in 
Fig.  43).  Repeating  the  procedure,  we  have  the  tree  shown  in  Fig.  43.  Notice  the  ter¬ 
mination  of  the  left  branch  at  {sj,s2}  because  all  states  that  can  be  reached  through 
one  step  of  transition  from  {s  j,  s2}  have  been  crossed  off  in  the  flow  table.  Therefore, 
the  shortest  synchronizing  sequence  that  synchronizes  s}  and  s3  in  Fig.  43  is  10,  while 
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the  shortest  synchronizing  sequence  that  synchronizes  s  j  and  s3  with  s ^  is  1011. 

4.3  A  SIMPLER  WAY  TO  CHECK  THE  SYNCHRONIZABILITY  OF 
AN  AUTOMATON 

Although  the  synchronizability  of  sets  of  states  can  always  be  checked  by  the  method 

described  above,  the  fact  that  the  number  of  states  in  A^  increases  very  rapidly  with 
increasing  number  of  states  in  A  makes  the  procedure  laborious  when  A  contains  a 
large  number  of  states.  The  following  theorem  leads  to  a  simpler  procedure  to  check 
the  synchronizability  of  an  automaton. 

THEOREM  15:  An  automaton  is  synchronizable  if  and  only  if  every  pair  of  its  states 
is  synchronizable. 

PROOF  15:  First,  we  prove  the  necessity.  Suppose  that  there  is  a  pair  of  states 
s.  and  Sj  that  are  not  synchronizable,  that  is,  for  every  input  sequence  t,  M(Sj,t)* 
M(Sj,t).  Obviously,  this  is  a  contradiction  to  the  fact  that  there  is  an  input  sequence  t' 
that  is  such  that  M{s.,tl)  =  M(s,,t')  =  . . .  M(s.,t')  =  .  .  .  M(s.,t')  =  .  .  .  M(s  ,  t '). 

Second,  we  prove  the  sufficiency.  By  assumption, 

3 1  j :  M(s  j ,  tj)  =  M<s2,tj) 

3t2:  M(M(Sj,tj),t2)  *  M(M{s3,tj),t2) 

M(8j,t,t2)  =  M(s2,t,t2)  =  M(s3,tjt2) 

3t3:  M(M<81,t1t2),t3)  *  M(M(s4,tjt2),t3) 

M(s  i ,  tit2t3)  =  M(s2,tIt2t3)  S  M(s3,t,t2t3)  =  M(s4,tjt2t3) 


3  W  MWSj.t^. .  .tn_2Mn-l>  *  M(M(sn.tlt2t3.  .  -t^'W 

W'vWi-  ■  ’Wn-l)  =  M(s2,tlt2t3.  .  -tn_2tn_i)  =  •  •  • 

Q  E  D 


COROLLARY  3:  A  sufficient  condition  for  a  set  of  p  states  in  an  automaton  to  be 
synchronizable  is  that  every  pair  of  states  of  the  automaton  is  synchronizable. 

On  the  basis  of  Theorem  15,  we  can  employ  the  following  procedures  to  check  the 
synchronizability  of  an  automaton. 

(a)  Form  the  flow  table  of  the  A^  automaton. 

(b)  List  all  simple  states  and  cross  them  off  in  the  column  S‘z'  of  the  flow  table. 

(c)  Add  to  the  list  all  compound  states  that  have  not  yet  been  crossed  off  in  the  flow 
table  and  can  reach  some  of  the  states  in  the  list  in  one  step  of  transition,  and  cross  off 
these  compound  states. 
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(d)  Repeat  step  (c)  until  no  further  repetition  is  possible.  If  all  of  the  states  of  A 
are  crossed  off,  A  is  synchronizable;  otherwise,  not. 

Figure  44  illustrates  this  test  procedure.  States  in  the  first  row  of  the  list 

{2} 

1  -  those  in  the  second  row  of  the  list  are 

,{2} 


are  underlined  once  in  the  column  S 
underlined  twice.  The  list  terminates  before  all  states  in  A' 


are  crossed  off, 
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and  the  automaton  A  is  thus  not  aynchronizable. 

4.4  ABSOLUTELY  SYNCHR0NI2ABLE  AUTOMATA 

In  an  automaton  A  *  {e,S,  M},  a  set  of  states  s.,  Sj,  s^  .  .  .  is  said  to  be  absolutely 
aynchronizable  with  state  su  if,  for  any  input  sequence  t  whose  length  is  equal  to  or 
larger  than  a  constant  m,  M(Sj,t)  *  M(Sj,t)  a  Mfs^.t)  a  ...  a  The  set  is  said  to  be 
absolutely  aynchronizable  if  M(Sj,  t)  a  M(s^,t)  a  M(s^,  t)  a  .  .  .  .  Similarly,  an  automaton 
is  said  to  be  absolutely  aynchronizable  (with  a  state  s  )  if  the  set  of  all  states  is  abso¬ 
lutely  synchronizable  (with  su).  Obviously,  an  automaton  having  a  finite  memory  span 
with  respect  to  the  input  is  absolutely  synchronizable  and  vice  versa. 


4.5  BOUNDS  ON  THE  LENGTH  OF  THE  SYNCHRONIZING  SEQUENCE 


THEOREM  16:  If  a  set  of  p  states  s.,  s.,  s,  .  .  .  in  an  automaton  A  is  synchro- 

1  J  K 

'u' 
p 


nizable  with  a  state  su>  an  upper  bound  on  the  length  of  the  shortest  synchronizing 


sequence  with  s  is  E  C?  -  1,  where  n  is  the  total  number  of  states  in  A. 
u  j*1  3 

PROOF  16:  The  automaton  A^  consists  of  E  C?  states.  If  there  exists  an  input 
sequence  t  that  is  such  that  M^p^({s.,  Sj,  s^. . .},  t)  =  {su},  then  there  exists  an  input 

sequence  L(t’)  *  E  C?  -  1  that  is  such  that  M^p^({s.,  8.,  s.  .  .  .},  t •)  *  {s  J.  Q.  E.D. 
jsl  J  1  J  K  u 

COROLLARY  4:  If  a  set  of  p  states  si#  s^,  sk  . . .  in  an  automaton  A  is  synchro¬ 
nizable,  the  upper  bound  on  the  length  of  the  shortest  synchronizing  sequence  is 

E  C?. 

j=2  J  {pi 

PROOF  OF  COROLLARY  4:  There  are  n  simple  states  in  AlF/.  If  we  consider 

these  n  states  to  be  combined  as  a  single  state,  the  resulting  automaton  will  have 
P  P 

E  c"  -  n  +  1  s  E  C?  +  1  states.  Any  sequence  that  leads  {s.,s.,  s.  . .  .}  to  this  com- 

j=l  J  j.2  J  1  J  K 

bined  state  is  a  synchronizing  sequence.  Q.  E.  D. 

Better  bounds  on  the  length  of  the  synchronizing  sequence  can  be  obtained  for  some 
special  automata. 


THEOREM  17:  In  a  synchronizable  automaton,  an  upper  bound  on  the  length  of  the 
shortest  synchronizing  sequence  that  synchronizes  any  set  of  p  states  is  (p-1)  c£. 

PROOF  17:  Let  s  j ,  s2  . . .  sp  be  the  set  of  states  to  be  synchronized.  By  the  argument 
of  necessity  in  Proof  15,  every  pair  of  states  in  this  set  is  synchronizable.  We  then  have 


3V 

UV  «  cn2 

M(Sj,  tj)  a 

M(s2,tj) 

3V 

L(t2)  «  Cl? 

M(s1,tjtz) 

a  M(S2,tjt2)  a  M(s3,tjt2) 

•p-r' 

LVl>  *  C2 

WVhV 

••tp-l)aM(S2'tlt2--tp-l)a'' 

.  =M(sp,t1t2...tp_1). 
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Here,  L(t.t_. .  .t  .)  *  (p-1)  c!J,  and  t.t,  . . .  t  .  is  certainly  a  synchronizing  sequence. 

1  &  r  ^  ^  “  P  ^  n  /II 

L(t.),  L(t_),  . . .  L(t  .)  are  all  less  than  or  equal  to  C,,  since  there  are  n(n-l)/2  ■  C, 
p 

compound  states  in  the  automaton  A1  1  and  the  length  of  the  shortest  input  sequence  that 
will  synchronize  a  compound  state  should  be  less  than  or  equal  to  C2-  Q.  E.  D. 

We  want  to  prove  the  following  lemmas. 

LEMMA  6:  If  sx  is  a  persistent  state  and  there  exists  an  input  sequence  t  that  is 

such  that  M(s  ,t)  *  s  ,  then  there  exists  an  input  sequence  t1  that  is  such  that  M(s  ,  t')» 
x  y  y 

8x 

PROOF  OF  LEMMA  6:  Write  t  *  o-.e-o'-  ...«■*■».  By  the  definition  of  a  per- 

12  3  p  q  r  * 

sistent  state  (Definition  12),  M(sx>  *j),  M(sx,  o-jO^),  M(sx>  e-jO-gOy  .  .Op<rq),  M^sx’ 

o-.o’.a, . .  .«r  <r  a)  are  all  persistent  states.  Moreover,  there  exists  an  input  sequence 
i  £>  j  p  cj  r 

tj  that  is  such  that  M(M(M(sx,  *2*3' '  <rprq^’  *  M(8X>  *1  *2*3' '  ^at  is* 

3t,:  M(sy,tj)  »  M(sx,ir1e2«r3.  ..(rpeq). 

Similarly, 

3t2:  M(M(M(sx,  «-j«-2ir3. .  .o-p),  eq),t2)  a  M(sx,  .  .#-p) 

3tr_j:  M(M(M(sx,<r1),«'2),tr_1)  a  M(sx>  o-j) 

3tr:  M(M(sx.e,).tr)  a  sx. 

Therefore,  M(sy,  t  jt2-  .  -tr_j)  a  sx.  Q.  E.  D. 

DEFINITION  23:  Two  states  sx,sy  are  connected  if  there  exist  input  sequences  tj,t2 

that  are  such  that  M(sx,tj)  a  sy  and  M(sy,t2)  a  sx- 

LEMMA  7:  If  two  persistent  states  s  and  s  are  synchronizable,  they  are  con- 

x  y 

nected. 

PROOF  OF  LEMMA  7: 

CASE  I:  There  exists  an  input  sequence  t  that  is  such  that  M(sx>t)  a  M(sy,  t)  a 
(or  sy).  By  Lemma  6,  there  exists  an  input  sequence  t'  that  is  such  that  M(sx,  t')  a  sy 
(or  M(sylt')  a  sx). 

CASE  II:  There  exists  an  input  sequence  t  that  is  such  that  M(s  ,  t)  a  M(s  ,  t)  a  s  . 

x  y  z 

By  Lemma  6  there  exist  t'  that  is  such  that  M(sz,t')  a  sx>  and  t*  that  is  such  that 

M(s  ,t")  »  a  .  Therefore  M(s  ,  tt")  ■  s  and  M(s  ,  tt')  a  a  .  Q.  E.D. 

*“  y  x  y  y  x 

We  now  have  the  following  theorem: 

THEOREM  18:  In  a  synchronizable  automaton,  if  a  set  of  p  states  s^,  »y  s^  . .  . 
is  synchronizable  with  a  persistent  state  su>  an  upper  bound  on  the  length  of  the  shortest 
synchronizing  sequence  that  synchronizes  this  set  of  states  with  su  is  (p-1)  C2  +  (n-1). 

PROOF  18:  By  Theorem  16,  there  exists  an  input  sequence  t  with  L(t)  <  (p-1)  c£ 
that  will  synchronize  the  set  of  states  Sj,  By  s^  . . .  with  an  arbitrary  state  sy.  sy  and 
sy  are  synchronizable  because  the  automaton  A  is  synchronizable.  If  sy  is  a  persistent 
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state,  by  Lemma  7,  su  and  sy  are  connected.  There  exists  an  input  sequence  t'  that 
is  such  that  M(sv<  t')  *  su.  tt '  will  then  be  the  synchronizing  sequence  that  synchro¬ 
nizes  Sj,  Sj,  s^  .  . .  with  su-  If  sy  is  a  transient  state,  there  exists  an  input  sequence 
t*  that  is  such  that  M(sv>t")  *  s^,  where  s^  is  a  persistent  state.  However,  s^  and  su 
are  connected;  thus  there  exists  an  input  sequence  tm  that  is  such  that  Mls^.t")  =  su- 
That  is,  M(s  ,t"tM)  =  s^,  and  tt"t"  is  then  the  synchronizing  sequence.  Since  both 
L(t')  and  L(t"t"l  are  less  than  or  equal  to  n-1,  we  have  proved  the  theorem.  Q.  E.D. 

We  finally  can  establish  the  bounds  for  absolutely  synchronizable  automata. 

THEOREM  19:  In  an  absolutely  synchronizable  automaton,  an  upper  bound  on  the 
length  of  the  shortest  synchronizing  sequence  is  n-1. 

PROOF  19:  This  bound  is  obvious  because  an  absolutely  synchronizable  automaton 
has  a  finite  memory  span.  Q.  E.  D. 

THEOREM  20:  In  an  absolutely  synchronizable  automaton,  an  upper  bound  on  the 
length  of  the  shortest  synchronizing  sequence  with  a  specific  state  sy  is  n-1. 

PROOF  20:  By  Theorem  14,  we  know  that  sy  must  be  a  persistent  state.  By  the 
definition  of  a  persistent  state  (Definition  12),  we  know  that  there  exists  an  input  sequence 
t'  with  L(t')  <  n  -  1  that  is  such  that  M(M(su>  c), t*)  =  s  .  Because  the  automaton  has  a 
finite  memory  span,  t'  is  a  synchronizing  sequence  that  synchronizes  the  automaton  with 

s  .  Q.  E.D. 

u 

4.6  COMBINED  AUTOMATA 

We  shall  introduce  here  some  ideas  that  should  help  to  reduce  the  labor  in  checking 

the  synchronizability  of  sets  of  states  in  an  automaton  and  may  give  a  better  bound  on 

the  length  of  the  shortest  synchronizing  sequence.  In  Section  III  we  defined  a  series  of 

combined  automata  A  .,  A  _,  A  -  .  .  .  for  an  automaton  A,  where  A  .  is  derived  from 
cl  cz  c3  cl 

A  by  combining  all  structurally  indistinguishable  states  in  A,  and  Ac2  is  derived  from 
Acl  by  combining  all  structurally  indistinguishable  states  in  Acl,  and  so  forth.  We 
called  Acx  the  exhaustively  combined  automaton  of  A,  if  A^  is  the  last  member  of 
the  series  A.,  A,,  A,  ...so  that  there  will  be  no  more  combinable  sets  of  indis- 
tinguishable  states.  In  other  words,  for  any  pair  of  states  s.  and  s^  in  A^,  there 
exists  an  input  symbol  <r  that  is  such  that  Mcx(s^,  »■)  #  Mcx(s^,(r).  Notice  that  in  the 
series  of  automata  A,A.,A_,A,...A  ,  every  automaton  is  a  homomorphic 

image  of  each  of  the  previous  automata.  In  particular,  Acx  is  an  homomorphic  image 
of  A.  Let  cx  denote  the  mapping  that  maps  the  states  in  S  of  A  into  the  states  in  Scx 
of  A  .  From  the  previously  adopted  notations,  for  a  state  s.  in  S  of  A  ,  c-1(s.) 

CX  J  CX  CX  X  J 

denotes  the  set  of  states  in  A  which  are  mapped  into  s.  by  c  .  We  then  have  the  fol- 

J  x 

lowing  theorem: 

THEOREM  21:  For  any  state  s.  in  A  ,  the  set  of  states  c”1^.)  in  A  is  absolutely 

J  CX  X  j 

synchronizable  by  any  input  sequence  of  a  length  equal  to  or  larger  than  a  constant  x. 
Moreover,  x  <  n  -  1,  where  n  is  the  number  of  states  in  A. 

PROOF  21:  Recalling  the  Beries  of  partitions  PQ,  Pj  . . .  defined  in  Section  III,  we 
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see  that  c  *(s.)  is  a  set  of  states  in  the  same  block  in  the  partition  P  .  After  x  steps 
of  transition,  all  states  of  this  set  will  enter  the  same  state,  that  is,  they  are  abso¬ 
lutely  synchronizable  by  input  sequences  of  length  x.  It  was  shown  in  Section  III  that 
x  <  n  -  I;  thus  the  proof  of  the  theorem  is  completed.  Q.  E.  D. 

THEOREM  22:  If  a  set  of  states  {s.,s.,s.  .  . .}  in  A  is  synchronizable,  then  the 

1  J  iv  CX 

set  of  states  {c^fSj), c^fSj), }  in  A  is  synchronizable. 

PROOF  22:  By  assumption,  there  exists  an  input  sequence  t  that  is  such  that 
Mcx(si(t)  =  Mcx(8j*t>  =  Mcx<Vl)  =  ••  =  V  Let  c>.)  :  s.,,  s,2  .  .  . ,  c^s.)  *  s.  Jt 
sj2  •  •  '  *  cx  ^sk^  =  skl’  Sk2  ' '  ‘  '  Be041136  cx  is  21,1  automaton  homomorphism,  cx(M(s.  j  ,t))  = 
Mcx^cx^3il^^  s  Mcx^si’^  =  su’  or  M(sii>t>  €  c‘‘(»u)-  Similarly- 

M(si2*t)  £  cx1(3u) 

M(Sji,t)  cc-’isj  M(s.2,t)tc^(sul 

M(8kl't)ccii1{3u)  M{sk2,t)  c  c-,(su) 


By  Theorem  21,  there  exists  an  input  sequence  t'  that  is  such  that  M(Sjj,tt')  =  M(s.2,tt')  = 
.  .  M(Sj  j ,  tt 1 )  =  M(sj2,tt')  =  .  .  .  M(skl,tt')  =  M(sk2,tt')  =  .  .  .  =  sul.  Q.E.D. 

COROLLARY  5:  If  s. j ,  Sj j,  skJ  .  .  .  in  A  are  synchronizable,  then  s.,  s^,  sk  .  .  . 
in  Afix  are  synchronizable. 

COROLLARY  6:  If  Sj  and  s^  in  A£x  are  not  synchronizable,  then  no  pair  of  states 
from  c  1  (s . )  and  c ,/(s.)  is  synchronizable,  and  vice  versa. 

XI  X  J 

PROOF  OF  COROLLARY  6:  Assume  that  there  is  a  pair  of  synchronizable  states 
from  c  1  (s . )  and  c  1  (a .).  By  Corollary  5,  s.  and  s.  are  synchronizable,  a  contradic- 

X  I  X  J  l  J 

tion  of  the  conditions  of  Corollary  6. 

Conversely,  assume  that  s^  and  s^  are  synchronizable.  By  Theorem  22  any  pair  of 
states  from  c  *(s.)  and  c  *(s.)  is  synchronizable,  also  an  obvious  contradiction. 

XI  X  J 

Q.E.D. 


From  Corollaries  5  and  6,  we  see  that  the  synchronizability  of  sets  of  states  in  A 
can  be  tested  in  Acx,  which  consists  of  fewer  states.  Moreover,  the  bounds  proposed 
in  Theorems  16-18  can  be  improved  too,  as  Figs.  45-48  illustrate.  (Note  that  in  Fig.  45 
the  states  in  Acx  are  primed  for  clarity.)  To  check  the  synchronizability  of  A,  we  only 
have  to  check  the  synchronizability  of  Acx-  Since  Acx  is  synchronizable,  A  is  synchro¬ 
nizable.  Applying  Theorem  17  directly  to  the  automaton  A,  we  have  (9-1)  C2  =  288  as 
an  upper  bound  on  the  length  of  the  shortest  synchronizing  sequence.  Applying  Theo- 

yi  I  A 

rem  17  to  Acx>  however,  we  have,  for  an  upper  bound,  (n'-l)  C2  +  (n-1)  =  (4-1)  C2  + 
(9-1)  *  26,  where  n1  is  the  number  of  states  in  A  .  Our  reasoning  is  as  follows.  In 

CX  _  | 

Acx  there  is  a  synchronizing  sequence  of  length  (n'-l)  C2  or  less.  From  Proof  22,  we 
see  that  this  sequence  will  also  lead  the  set  of  all  states  in  A  to  a  set  of  states  that  is 
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absolutely  synchronizable.  Thus  by  Theorem  21  any  sequence  of  length  n-1  will  syn¬ 
chronize  this  set  of  states.  Moreover,  we  can  actually  find  a  synchronizing  sequence 

for  A  by  finding  one  for  A  first.  Construct  the  essential  part  of  A^  as  shown  in 

cx  cx 

Fig.  46.  We  see  that  the  shortest  synchronizing  sequence  for  A  is  01011010,  which 

-1  r  i  cx 

will  synchronize  all  states  to  sj.  Since  cx  (sj)  *  {s^.Sg.s^J-,  we  want  to  find  a  syn¬ 
chronizing  sequence  to  synchronize  s^,  Sg,  s^  in  A.  A  portion  of  the  essential  part 

of  A^  is  shown  in  Fig.  47.  From  Fig.  47,  0101101000,  0101101001,  0101101010,  and 
0101101011  are  synchronizing  sequences  for  A.  Notice  that,  in  some  cases,  the  syn¬ 
chronizing  sequence  obtained  in  this  manner  is  not  necessarily  the  shortest  possible 
synchronizing  sequence.  For  example,  in  Fig.  46,  the  sequence  01011011  leads  all 
states  in  Acx  to  {a£,  s^}.  It  might  be  possible  (but  not  in  this  example)  that  the  set  of 

states  {c^^sp,  c'^s^)}  »  {sg.  Sg,  Sj}  has  a  synchronizing  sequence  shorter  than  that 

of  the  set  {s4>Sg,  s^}.  Then  there  would  be  synchronizing  sequences  for  A  which  are 

shorter  than  those  found  above  In  this  example,  however,  the  sequences  that  we  found 

are  really  the  shortest  synchronizing  sequences. 

Furthermore,  we  can  tell  immediately  that  Sj,  s^,  s?  in  A  are  synchronizable  by 

a  synchronizing  sequence  of  a  length  equal  to  or  less  than  9-1*8  (compared  with  the 
q 

bound  (3-1)  C2  a  72  given  by  Theorem  17).  The  set  of  states  Sj,  s3>  s^,  s?  is  syn¬ 
chronizable,  and  any  input  sequence  of  length  3  is  one  of  the  shortest  synchronizing 
sequences  (sj  and  s^  in  Acx  are  synchronized  with  sj  by  the  input  sequence  0,  and  the 

states  of  the  set  c”1^)  are,  in  turn,  synchronized  by  00,  01,  10,  11). 

In  Fig.  48,  A  is  not  synchronizable  because  A£X  is  not  synchronizable.  Moreover, 
none  of  the  sets  of  states  {sj.s^,  {sj.s^.Sg},  {sj,s5}. . .  are  synchronizable  because 


Figure  47 
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{aj,  s^}  ia  not  synchronizable. 

4.7  SOME  APPLICATIONS 

Suppoae  that  there  ia  an  automaton  that  ia  in  an  unknown  initial  atate  and  we  want  to 
reaet  the  automaton  to  a  preaelected  atate  Sj,  but  there  is  no  resetting  switch  available. 
If  the  automaton  is  aynchronizable  with  8.,  we  need  only  apply  an  appropriate  synchro¬ 
nizing  sequence.  Aa  another  example,  suppose  that  several  copies  of  identical  automata 
in  different  unknown  initial  states  are  connected  in  parallel  (they  are  accepting  identical 
input  sequences)  and  we  want  to  reset  them  to  the  same  initial  state  or  to  a  certain  spe¬ 
cific  initial  state.  The  principles  of  synchronization  can  be  applied  immediately. 

Synchronization  also  can  be  applied  to  an  automaton  used  as  a  decoder.  The  autom¬ 
aton  starts  from  a  certain  initial  state  8j,  receives  an  input  code  word,  decodes  it, 
gives  the  corresponding  outputs,  returns  to  Sj,  and  waits  for  the  next  input  code  word. 

If  tj,  t2>  tj  . . .  are  code  words,  it  is  certainly  true  that  M(Sj,tj)  =  Sj,  M(s , ,  t2)  =  s,, 
M(Sj,t3)  =  Sj  ...  .  However,  if  some  errors  occur  during  the  transmission  of  a  string 
of  code  words,  for  example,  some  input  symbols  are  received  incorrectly  or  some  input 
symbols  are  erased,  then  the  normal  decoding  procedure  would  be  disturbed.  If  the 
automaton  does  not  return  to  s  j  after  decoding  a  certain  code  word  because  of  some 
error  occurring  in  that  code  word,  the  subsequent  code  word  will  not  be  decoded  cor¬ 
rectly.  This  effect  might  propagate,  and  the  automaton  thus  would  give  many  succes¬ 
sive  meaningless  output  symbols.  We  naturally  ask  the  question:  How  can  we  prevent 
the  normal  decoding  procedure  from  being  disturbed,  although  errors  may  occur  during 
the  transmission?  The  answer  is  that  the  code  words  tj,  t2,  tj  . . .  must  be  synchro¬ 
nizing  sequences  that  will  synchronize  the  automaton  with  Sj.  Suppose  that  a  string  of 
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code  words  tp^  ...  is  transmitted  and  some  error  occurs  during  the  transmission  of 
V  titjtk  '  ‘ '  *8  then  received,  tj  will  not  be  decoded  correctly.  Since  M(s  j ,  tp  is  not 
necessarily  equal  to  Sj,  the  code  word  tj  may  be  decoded  incorrectly  too.  However, 
MUj.tpj)  *  M(M(8j,tp,t^)  *  Sj  because  t^  is  a  synchronizing  sequence  with  Sj.  There¬ 
fore,  t^  and  the  subsequent  code  words  will  be  decoded  correctly.  We  see  that  in  this 
example  the  effect  of  errors  will  never  propagate  beyond  a  correctly  received  code  word. 

4.8  SYNCHRONIZATION  OF  DIFFERENT  AUTOMATA 

In  two  automata  A  3  {z,  S,  M}  and  B  3  {2,  S',  M1},  a  pair  of  states  s.  and  s!  is  said 
to  be  synchronizable  simultaneously  with  another  pair  of  states  s  and  s'  if  there  exists 
an  input  sequence  t  of  finite  length  which  i3  such  that  M(s^,t)  3  au  and  M'(spt)  *  s^, 
where  s.,  st  e  S  and  sj,  s^  £  S'.  By  extending  this  definition,  a  set  of  states  s^,  s,, 

. . .  €  S  and  a  set  of  states  s),  sj  . .  .  e  S'  are  said  to  be  synchronizable  simultaneously 
(with  su  and  s^)  if  there  exists  an  input  sequence  t  that  is  such  that  M(s.,t)  *  M(s,,t)  3 
.  . .  (=8u>  and  M'(sj,  t)  =  M'(sj,t)  =  . . .  (=sjp.  Furthermore,  A  and  B  are  said  to  be 
synchronizable  simultaneously  (with  su  and  s 1 )  if  the  set  of  all  states  in  S  and  the  set 
of  all  states  in  S'  are  synchronizable  simultaneously  (with  sy  and  sjp.  To  investigate 
the  synchronizability  of  sets  of  states  in  different  automata,  we,  again,  can  employ  the 
idea  of  product  automata  which  we  developed  before.  In  general,  for  the  synchronization 
of  a  set  of  p  states  in  A  and  a  set  of  q  states  in  B,  we  can  study  the  automaton 

A^  X  B^.  With  respect  to  the  length  of  the  synchronizing  sequence,  we  have  the  fol¬ 
lowing  bounds. 

THEOREM  23:  If  a  set  of  p  states  in  A  and  a  set  of  q  states  in  B  are  simulta¬ 
neously  synchronizable  with  su  and  s^,  the  upper  bound  on  the  length  of  the  shortest 
synchronizing  sequence  is 

P  q 

Ic?x  I 

i=l  j=l 

where  n  and  n'  are  the  number  of  internal  states  in  A  and  B,  respectively. 

PROOF  23:  A^  has  E  C?  states  and  has  Z  C?  states;  therefore,  A^  X 
isl  1  J 

B^  has  E  C"X  E  c"'  states.  Q.E.D. 

i=l  1  j=l  J 

COROLLARY  7:  If  a  set  of  p  states  ih  A  and  a  set  of  q  states  in  B  are  synchro¬ 
nizable  simultaneously,  the  upper  bound  on  the  length  of  the  shortest  synchronizing 
sequence  is 

P  q 

Ic°x 

isl  jsl 
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PROOF  OF  COROLLARY  7:  In  X  B^,  there  are  n  X  n'  states  that  are 
ordered  pairs  like  ({su},{s^}).  Q.  E.D. 

THEOREM  24:  If  A  is  synchronizable  and  B  is  sy nchr onizable ,  then  A  and  B  are 
synchronizable  simultaneously. 

PROOF  24: 

3t:  M(s  j,  t)  *  M(s2,t)  *  .  . .  M(sn>t)  *  sy 

3t':  M'(s'.t')  «  M'(s^t')  »  . . .  M’fs^t')  =  s^. 

Then, 

M(s,,tt')  a  M<S2,tt')  a  ...  M(Sn,tt')  *  M(Sy,t') 

M'ts'j.tt*)  a  M'(s£.tt')  a  . . .  M'(s^,tt')  =  S^.  Q.E.D. 

COROLLARY  8:  If  A  and  B  are  synchronizable  simultaneously,  the  upper  bound 
on  the  length  of  the  shortest  synchronizing  sequence  is  (n-1)  C2  +  (n'-l)  c”  . 

PROOF  OF  COROLLARY  8:  By  Theorem  17,  the  bounds  on  the  lengths  of  the  short¬ 
est  possible  t  and  t'  are  (n-1)  C2  and  (n'-l)  C2  ,  respectively.  Q.E.D. 

THEOREM  25:  If  A  is  absolutely  synchronizable  by  any  sequence  of  length  equal 
to  or  larger  than  m+1  and  B  is  absolutely  synchronizable  by  any  sequence  of  length 
equal  to  or  larger  than  m'-l-l,  then  any  set  of  states  in  A  and  any  set  of  states  in  B  can 
be  synchronized  simultaneously  by  any  sequence  of  length  equal  to  or  larger  than  m+1 
or  m'+l,  whichever  is  the  larger. 

PROOF  25:  Suppose  that  m  >  m'  (the  proof  for  m'  >  m  is  identical).  For  any  sets 
of  states  s^  Sj  . . .  c  S  and  s!,  sj  . . .  €  S',  and  for  any  t  with  L(t)  »  m  +  1,  by  ihe  def¬ 
inition  of  absolute  synchronizability 

MfSj.t)  =  Mfs^t)  a  .  .  . 

M'(sJ.t)  a  M'(s't)  *  ...  .  Q.E.D. 

In  order  to  reduce  the  labor  of  checking  the  synchronizability  and  to  obtain  a  better 
estimation  of  the  bounds  on  the  length  of  the  shortest  synchronous  sequences,  we  can 
combine  indistinguishable  states  in  each  individual  automaton  as  we  did  in  section  4.6. 
The  ideas  introduced  previously  can  be  applied  directly  to  the  synchronization  of  two 
different  automata. 

The  synchronization  of  more  than  two  different  automata  is  a  direct  extension  of  the 
synchronization  of  two  different  automata. 
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V.  MEMORY  ORDER  OF  STATES 


5.  1  MEMORY  ORDER  OF  STATES  WITH  RESPECT  TO  THE  INPUT 

In  Sections  III  and  IV  we  discussed  the  cases  in  which  the  input  sequence  to  an  autom¬ 
aton  is  known  but  the  initial  state  of  the  automaton  is  unknown.  In  this  section  we  shall 
investigate  the  case  in  which  a  portion  of  the  input  sequence  to  the  automaton  is  unknown 
although  the  initial  state  is  known.  We  start  with  the  following  definitions. 

DEFINITION  24:  In  an  automaton  A  =  {Z,  S,  M},  a  state  s .  has  a  memory  order  equal 
to  p.  if  M(s.,  tjt)  =  M(s.,  t2t)  for  any  input  sequences  tj,  t2  with  L(tj)  =  L(t2)  =  p  and  t 
with  L(t)  a  K,  where  K  is  a  constant  for  this  specific  automaton,  and  if  there  exist  input 
sequences  tj,  t4  with  L(tj)  =  L(t4)  =  p  +  1.  and  t1  of  any  arbitrary  length  which  is  such 
that  MlSj.tjt')  4  M(si(t4t'). 

Definition  24  means  that  if  an  automaton  is  in  a  state  having  a  memory  order  equal 
to  p,  then  p  successive  unknown  input  symbols  can  be  applied  without  jeopardizing  our 
ability  to  discover  eventually  the  state  of  the  automaton  by  observing  the  next  K  input 
symbols.  From  this  definition,  we  see  that  if  a  state  si  does  not  have  a  memory  order 
p,  it  will  not  have  memory  order  larger  than  p. 

DEFINITION  25:  In  an  automaton  A  =  {z,S,  m}.  a  state  si  has  an  infinite  memory 
order,  if  Mfs^tjt)  =  Mfs^  t2t)  for  any  input  sequences  tj,  t2  with  L(tj)  =  L(t2)  and  t 
with  L(t)  J  K,  where  K  is  a  constant  for  this  specific  automaton. 

a.  Memory  Order  of  States  in  Exhaustively  Combined  Automata 

From  Definitions  24  and  25,  the  memory  order  of  a  state  in  a  given  automaton  may 
be  found  by  enumerating  all  possible  input  sequences  and  examining  every  possible  value 
of  p.  This  method  is  obviously  very  tedious.  Furthermore,  we  shall  not  know  whether 
or  not  we  should  stop  testing  if  this  state  has  an  infinite  memory  order.  An  effective 
method  to  determine  the  memory  order  of  a  state  will  be  introduced,  but  the  simpler 
case  of  an  exhaustively  combined  automaton  is  studied  first.  As  defined  previously,  an 
exhaustively  combined  automaton  A  =  {z,  S  ,  M  }  is  one  in  which  for  all  s.,  s.  e  S 

CX  CX  CX  X  J  UX 

there  exists  an  input  symbol  <r  that  is  such  that  Mcx(®j,<  a)  4  Mcx(®j* <T)- 

THEOREM  26:  In  an  exhaustively  combined  automaton  A  =  {z,  S  ,  M  },  a  state 

CX  CX  cx^ 

8.  has  a  memory  order  equal  to  p  if  and  only  if  (a)  =  MCx^Bi’t2^  ^or  a11  *1 

and  t2  whose  lengths  are  equal  to  p  and  (b)  there  exist  t ^  and  t4  whose  lengths  are  equal 
to  p  +  1  which  are  such  that  *  Mcx^8i,t4^' 

PROOF  26:  First,  we  prove  the  necessity.  Suppose  that  there  exist  t'j  and  t£  whose 
lengths  are  equal  to  p  so  that  Mcx(Sj,  t'j)  *  Mcx(Sj,t£).  Because  Acx  is  exhaustively 
combined,  there  exists  that  is  Buch  that  Mcx(Mcx<Sj,  t'j),  ira)  #  Mcx^MCx^8i'  *2^'  ®a^‘ 
Similarly,  there  exists  <rb  that  is  such  that  M^IM^jSj,  t'i,ra^'  ffb^  *  Mcx^Mcx^8i'  °b^' 

Repeating  this  argument,  we  can  have  an  input  sequence  t  =  ...  of  any  arbitrary 

length  so  that  4  Mcx(s^,  t£t).  Therefore  s^  has  a  memory  order  smaller  than 
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p.  Suppose  that  for  all  t^  and  tj|  whose  lengths  are  equal  to  p  t  1,  ^cx^3i‘  *3>  = 

Mcx(si't4)-  For  “y  t*  Mcx<sl't3t)  =  Mcx(si't4t)-  Therefore*  8i  has  a  memory  order 
larger  than  p. 

Second,  we  prove  the  sufficiency.  Since  Mcx(s t  j )  =  Mcx(si«*2)  for  tj  and  t,, 
whose  lengths  are  equal  to  p,  Mcx(Sj,tjt)  =  MCx^8i*t2t^  tor  any  since  there  exist  t3 
and  t4  whose  lengths  are  equal  to  p  +  1  so  that  Mcx(s^t3)  ¥  M(Sj,  t4),  by  the  same  argu¬ 
ment  used  above  there  exists  an  input  sequence  t  of  any  arbitrary  length  which  is  such 
that  Mcx<s.,  t3t)  ¥  M(s.,  t4t).  Q.  E.  D. 

COROLLARY  9:  In  an  exhaustively  combined  automaton  Afix  =  {£»  scx«  Mcx}«  a  state 
has  an  infinite  memory  order  if  and  only  if  for  all  tj  and  t^  whose  lengths  are  equal, 

McxK'V^cx^i'V- 

By  Theorem  26,  we  can  easily  recognize  a  state  having  a  zero  memory  order  in  an 
exhaustively  combined  automaton.  If  a  state  s^  has  a  memory  order  equal  to  zero,  there 
exist  input  symbols  c-j  and  that  are  such  that  Mcx(sj*iri)  ¥  Mcx(s.,  On  the  other 
hand,  if  a  state  has  a  nonzero  memory  order,  we  shall  have  Mcx(s^,  ^j)  =  ^cx^si’  ^ 
for  any  input  symbols  o-j  and  The  following  theorem  will  be  helpful  in  determining 
the  memory  orders  of  states. 

THEOREM  27:  In  an  exhaustively  combined  automaton  A  ={E,S  ,  M  },  if  a  state 

s^  has  a  nonzero  finite  memory  order  equal  to  p,  that  is,  <*  >  p  >  0,  then  for  any  input 
symbol  <Tj,  M(si(  <Tj)  has  a  memory  order  equal  to  (p—  1 ). 

PROOF  27:  (a)  For  any  input  sequences  tj  and  t2  of  length  p  -  1,  Mcx(Mcx(8i>,ri)>ti)  = 

Mcx<Mcx*si‘  <ri)'  V'  since  *1*1  and  ^1*2  are  inPut  sequences  of  length  p. 

(b)  There  exist  tj  and  t4  of  length  p  +  1  so  that  Mcx(s.,  tj)  ¥  Mcx(si>t4)>  Writing 

t3  =  <rat|j  and  t4  =  o^,  we  have  *  M<Mcx(si’lrb>,t4)’  Since  Mcx*Si,<rl*  * 

Mcx<*i*'a>  -Mcx<Bi‘rb>*  thenMcx<McxUi.r1).n)#MCJ|(McX(Si.al).ti).  Q.E.D. 

COROLLARY  10:  For  any  state  s.  having  a  finite  memory  order  equal  to  p  in 
an  exhaustively  combined  automaton  A  ={E,  S  ,  M  }  consisting  of  n  states,  p  « 

La  LA  LA 

n  -  1. 

COROLLARY  11:  In  an  exhaustively  combined  automaton  A  =  {2,  S  ,  M  },  if  a 
state  s^  has  an  infinite  memory  order,  then  Mcx(8^  <fj)  has  an  infinite  memory  order 
for  any  input  symbol  <Tj. 

To  determine  the  memory  order  of  a  certain  state  s^,  we  shall  trace  the  step- 
by-step  transitions  from  s. .  If  a  state  having  a  memory  order  equal  to  zero  is 
entered,  we  know  that  s .  has  a  finite  memory  order.  If  a  state  having  a  memory 
order  equal  to  zero  has  not  been  entered  after  n-1  steps  of  transition,  s^  has  an 
infinite  memory  order.  Figure  49  illustrates  the  manner  in  which  we  find  the  mem¬ 
ory  orders  of  the  states  of  an  exhaustively  combined  automaton.  In  Aqx,  s4  has  a 
memory  order  equal  to  zero.  Since  ^cx(a2»  ®)  =  ^cx^a2'  ^  =  s4'  s2  ^as  a  memory 
order  equal  to  1;  then  s3  has  a  memory  order  equal  to  2;  s  j  and  s^  have  infinite 
memory  orders.  If  we  draw  the  transition  diagram  as  that  shown  in  Fig.  49b,  the 
memory  order  of  each  state  is  evident. 
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b.  The  General  Case  of  All  Automata 


The  result  obtained  above  can  be  extended  immediately  to  all  automata.  We  have 
the  following  theorems: 

THEOREM  28:  Let  A„v  =  {s,  S  ,  M„v}  be  the  exhaustively  combined  automaton  of 

A  ={2,  S,  M}.  Any  state  si  in  S  has  the  same  memory  order  as  cx(s^)  in  Scx- 

PROOF  28:  (a)  Suppose  that  c^s^)  has  a  memory  order  p.  That  is,  for  any  input 

sequences  t,  and  t,  of  length  p,  M  (c  (s.),t.)  =  M  (c  (s.),t_)  =  s'  .  Because  A  is 
n  12  a  cx»  x»  Cx'  x»  2'  u  cx 

a  homomorphic  image  of  A,  M(s.,t,)  e  c""*(b')  and  M(s.,t_)  e  c'^s1).  But  by  Theo- 

rem  21  M(s^,  tj)  and  M(s^,  t^)  are  absolutely  synchronizable  by  any  input  sequence  t  of 

length  equal  to  or  larger  than  n-1,  where  n  is  the  number  of  states  in  A.  Therefore, 

Mts-.tjt)  =  M(s.,t2t). 

(b)  Since  the  state  cx(s^)  has  a  memory  order  p,  there  exist  input  sequences 
t3  and  t4  of  length  p  +  1,  so  that  Mcx(cx(s.),  t3)  *  MCx^cx^si^'  V’  Also»  as  shown 
in  Proof  26,  there  exists  an  input  sequence  t  of  arbitrary  length  so  that  Mcx(cx(Sj),  t3t)  # 
Mcx*cx*si^'t4t*'  Therefore,  M(s.,t3t)  #  MfSj,  t4t).  Q.  E.D. 

COROLLARY  12:  In  Definitions  24  and  25  K  «n  -  1,  where  n  is  the  number  of  states 
of  the  automaton  A. 

Figure  50  shows  the  manner  in  which  we  find  the  memory  order  of  each  state  of  a 


given  automaton.  From  the  state  diagram  of  Acx  in  Fig.  50,  we  see  that  s’j  has  a  mem 
ory  order  equal  to  3,  s^  has  a  memory  order  equal  to  2,  s^  has  a  memory  order  equal 
to  1,  and  s^  has  a  memory  order  equal  to  zero.  In  A,  Sj  has  a  memory  order  equal 
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Figure  50 

to  3;  and  s,.  have  memory  orders  equal  to  2;  s^,  s^,  and  have  memory  orders 
equal  to  1,  and  s^,  s^,  and  s?  have  memory  orders  equal  to  zero. 

Theorem  27  and  Corollaries  10  and  11  can  be  extended  as  follows: 

THEOREM  29:  In  an  automaton  A  =  {£,  S,  M},  if  a  state  s.  has  a  nonzero  finite  mem¬ 
ory  order  equal  to  p,  then  M(s.,  <r)  has  a  memory  order  equal  to  (p-1)  for  any  input  sym¬ 
bol  a. 

PROOF  29:  By  Theorems  27  and  28.  Q.  E.D. 

COROLLARY  13:  For  any  state  s^  having  a  finite  memory  order  equal  to  p  in  an 
automaton  A  consisting  of  n  states,  p  «n  -  1. 

PROOF  OF  COROLLARY  13:  The  number  of  states  of  the  exhaustively  combined 
automaton  Acx  is  less  than  or  equal  to  the  number  of  states  of  A.  Q.  E.D. 

COROLLARY  14:  In  an  automaton  A  =  {E,  S,  m},  if  a  state  s^  has  an  infinite  memory 
order,  then  for  any  input  symbol  a,  M(s^,  it)  has  an  infinite  memory  order. 

Notice  that  in  an  automaton  having  a  finite  memory  span  with  respect  to  the  input, 
every  state  has  an  infinite  memory  order.  This  fact  follows  from  the  discussion  in  Sec¬ 
tion  III  that  the  exhaustively  combined  automaton  of  an  automaton  having  a  finite  memory 
span  with  respect  to  the  input  consists  of  only  one  state.  However,  the  converse  of  this 
statement  is  not  necessarily  true.  That  is,  an  automaton  does  not  necessarily  have  a 
finite  memory  span  if  each  of  its  states  has  an  infinite  memory  order. 

From  Theorem  29,  we  can  develop  a  very  illustrative  pictorial  representation  of 
the  memory  order  of  a  state  in  an  automaton,  as  illustrated  in  Fig.  51.  Consider  a 
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staircase  of  p  steps.  An  initial  state  having  a  memory  order  equal  to  p  will  correspond 
to  a  ball  sitting  on  the  pth  step  of  the  staircase  (see  Fig.  SI  a).  For  any  input  symbol, 
known  or  unknown,  the  transition  will  lead  to  a  state  having  a  memory  order  equal  to 
p  -  1.  This  corresponds  to  moving  the  ball  one  step  down  to  the  (p-l)**1  step  of  the 
staircase.  For  an  automaton  in  a  state  having  an  infinite  memory  order,  the  corre¬ 
spondence  is  to  a  ball  sitting  on  a  platform  of  infinite  length  on  which  the  ball  rolls  with 
no  change  of  its  height  (Fig.  Sib).  For  an  automaton  in  a  state  having  a  zero  memory 
order,  the  correspondence  is  to  a  ball  sitting  at  the  end  of  a  staircase.  For  a  known 
input  symbol,  the  ball  will  be  moved  to  some  state  having  a  memory  order  equal  to  «, 
p  or  0.  For  an  unknown  input  symbol,  the  bail  will  drop  to  minus  infinity  (Fig.  51c). 

This  indicates  that  if  the  automaton  is  in  a  state  having  a  memory  order  equal  to  zero 
and  the  next  input  is  unknown,  we  shall  lose  track  of  the  final  state  of  the  automaton. 

If  the  initial  state  of  the  automaton  in  Fig.  49  is  s2,  then  Fig.  52a  illustrates  the 

effect  of  an  input  sequence  -  1 - 0 - ,  and  Fig.  52b  illustrates  the  effect  of  an  input 

sequence  —  1 - (the  —  are  unknown  input  symbols).  We  can  see  that,  for  an  initial 

state  S|,  if  we  want  to  find  M(s^,  t),  all  that  we  have  to  know  about  the  input  sequence 
t  are  the  last  n-1  input  symbols  and  those  "critical  input  symbols"  that  Bpecify  the 
transitions  from  states  having  a  memory  order  equal  to  zero.  For  the  example  in 

Fig.  52a,  among  the  symbols  in  the  sequence  —  1 - 0 - ,  only  1  and  0  are  critical 

input  symbols.  In  other  words,  if  an  automaton  starts  from  a  certain  initial  state  and 
if  the  critical  input  symbols  and  the  last  n-1  input  symbols  of  two  input  sequences  to 
the  automaton  are  identical,  the  final  state  of  the  automaton  must  be  the  same  for  both 
sequences. 

In  a  practical  situation,  when  the  input  symbols  are  sent  through  a  binary  erasure 
channel  to  an  automaton,  all  of  the  symbols  other  than  the  critical  input  symbols  and 
the  last  n-1  symbols  of  the  sequence  can  be  erased  as  long  as  we  are  concerned  with 
only  the  final  state  of  the  automaton  (Fig.  53).  Furthermore,  if  the  transmission  chan¬ 
nel  is  a  binary  symmetric  channel,  then  all  input  symbols  other  than  the  critical  ones 
and  the  last  n-1  can  tolerate  an  error. 

5.  2  MEMORY  ORDER  OF  STATES  WITH  RESPECT  TO  THE 
INPUT -OUTPUT  SEQUENCE 

We  can  now  extend  our  discussion  to  the  case  in  which  we  have  access  to  both  the 
input  and  the  output  symbols.  Similar  to  the  definitions  for  the  case  of  the  memory 
orders  of  states  with  respect  to  the  input  symbols  are  Definitions  26  and  27. 

DEFINITION  26:  In  an  automaton  A  =  {e,  Z,  S,  M.N},  a  state  Sj  has  a  memory  order 
equal  to  p  with  respect  to  the  input-output  sequence,  if  (a)  Rfs^,  WjW)  *  R(Sj,  w2w)  for 
any  input-output  sequences  Wj  and  w2  with  L(Wj)  «  L(w2)  =  p  and  w  with  L(w)  >K,  where 
K  is  a  constant  for  this  specific  automaton,  and  (b)  there  exist  input -output  sequences 
w3  and  w^  with  L(w})  *  L(w^)  «  p  +  1,  and  exists  input -output  sequence  w  of  any  arbi¬ 
trary  length,  so  that  R(Sj,  w3w)  and  R(Sj,  w^w)  are  incompatible. 
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DEFINITION  27:  In  an  automaton  A  ■  {E,  Z,  S,  M,  N},  a  state  has  an  infinite  mem¬ 
ory  order  with  respect  to  the  input-output  sequence,  if  Rfs^.WjW)  *  R(8j,w2w)  for  any 
input-output  sequences  Wj  and  w2  with  L(Wj)  x  L(w2)  and  w  with  L(w)  S’  K,  where  K  is 
a  constant  for  this  specific  automaton. 

As  we  can  see,  the  method  developed  above  to  find  the  memory  order  with  respect 
to  the  input  of  the  states  of  an  automaton  does  not  apply  in  the  present  case,  since  the 
compatibility  relation  of  the  function  R  is  not  transitive.  (See  discussion  following  Cor¬ 
ollary  1.)  We  have  another  method  to  check  the  memory  order  of  a  state  with  respect 
to  the  input-output  sequence.  Following  the  notations  and  definitions  in  Section  III,  we 
have 

DEFINITION  28:  A  set  of  states  s^,  s^,  sk  . .  .  in  an  automaton  A  =  {E,  Z,  S,  M,  N}  has 
a  unique  final  state  with  respect  to  the  input-output  sequence  if,  for  all  su  and  in  the 
set  and  for  ail  input-output  sequences  w  of  length  equal  to  or  larger  than  a  constant  K, 
R(su,w)  *  R(sy,  w). 

THEOREM  30:  A  set  of  states  s^,  Sj,  sk  . . .  in  an  automaton  A  =  {e,  Z,  S,  M,  N}  will 
have  a  unique  final  state  with  respect  to  the  input-output  sequence  if  and  only  if  every 
pair  of  states  in  this  set  has  a  unique  final  state  with  respect  to  the  input-output 
sequence.  (Theorem  30  is  a  slightly  more  general  form  of  Theorem  10.) 

PROOF  30:  First,  we  prove  the  necessity.  Suppose  that  there  is  a  pair  of  states 
s  ■  and  Sj  which  does  not  have  a  unique  final  state  with  respect  to  the  input-output 
sequence,  that  is,  there  exists  an  input-output  sequence  w  of  length  equal  to  or  larger 
than  any  constant  K,  so  that  R(Sj,  w)  and  R(s^,w)  are  incompatible.  It  is  obvious  that 
this  set  of  states  does  not  satisfy  Definition  28  as  a  Bet  having  a  unique  final  state  with 
respect  to  the  input-output  sequence. 

Second,  we  prove  the  sufficiency.  For  any  pair  of  Btates  si  and  s^,  and  for  any  (a,  z) 
in  E  X  Z,  if  R(s^,  (<r,  z))  *  R(s^,  (a,  z)),  then  s.  and  s^  obviously  have  a  unique  final  state 
with  respect  to  the  input-output  sequence.  If  the  values  of  R(si#  (a,  z))  and  R(Sj,  (o',  z)) 
are  not  equal,  they  must,  in  turn,  have  a  unique  final  state  with  respect  to  the  input- 
output  sequence.  We  can  repeat  this  argument.  The  repetition,  however,  will  not  go 
beyond  n(n-l)/2  steps,  since  there  are  a  total  of  n(n-l)/2  distinct  pairs  of  states  in  A. 
Otherwise,  s^  and  s^  will  not  have  a  unique  final  state  with  respect  to  the  input-output 
sequence.  Such  a  result  would  be  a  contradiction  to  the  conditions  of  the  theorem. 
Therefore,  for  any  input-output  sequence  w  with  L(w)  Jn(n-l)/2,  R(su,  w)  *  R(sv>  w) 
for  all  su  and  sy  in  the  set. 

COROLLARY  15:  In  Definitions  26-28  K  «  n(n-l)/2. 

THEOREM  31:  Let  Uk  denote  a  set  of  states  {sj,  Sj,  sk> . .}  and  Uk+J  denote  the  set 
of  states  {R(s^,  (iTj.  Zj)),  R(8i,  (o-j,  z2». . .  R(s^,  (orj,  Zj)). .  .}  for  all  s  in  UR  and  all  (cr,  z) 
in  E  X  Z  which  are  such  that  R(s,  (<r,  z))  is  defined,  (a)  If  Uk  does  not  have  a  unique  final 
state  with  respect  to  the  input-output  sequence,  then  Uk+1  will  not  have  a  unique  final 
state  with  respect  to  the  input-output  sequence,  (b)  If  Uk+1  has  a  unique  final  state  with 
respect  to  the  Input-output  sequence,  then  Uk  has  a  unique  final  state  with  respect 
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to  the  input-output  sequence. 

PROOF  31;  (a)  Suppose  that  there  is  a  pair  of  states  Sj  and  s^  in  the  set  Uk  and  an 
input-output  sequence  (ffj,  Zj)w  of  any  arbitrary  length  which  are  such  that  R(Sj,  (o^ ,  Zj)w) 
and  R(Sj,  (<Tj,  Zj)w)  are  incompatible.  That  is,  RfRfSj,  (<Tj,  Zj)),  w)  and  R(R(Sj,  (o-j,  Zj)),  w) 
are  incompatible.  R(Sj,  (o-j,  z^))  and  R(sk,  (Sj,  Zj))  must  be  defined;  otherwise  they  will 
be  compatible.  RISj,  (o-j,  z^)  and  R(Sj,  (ffj,  z j))  are  in  Uk+j.  Therefore,  Uk+1  does  not 
have  a  unique  final  state  with  respect  to  the  input-output  sequence. 

(b)  Suppose  that  Uk+1  has  a  unique  final  state  with  respect  to  the  input-output 
sequence.  If  does  not  have  a  unique  final  state  with  respect  to  the  input -output 
sequence,  by  the  argument  in  the  preceding  paragraph,  Uk+j  will  not  have  a  unique  final 
state  with  respect  to  the  input-output  sequence.  This  result  would  be  a  contradiction 
to  our  assumption.  Q.  E.  D. 

THEOREM  32:  For  any  state  s .  having  a  finite  memory  order  equal  to  p  with  respect 
to  the  input-output  sequence  in  an  automaton  A  consisting  of  n  states,  p  is  less  than 
or  equal  to  n  +  [n(n-l)/2]  -  2. 

PROOF  32:  Let  UQ  denote  the  set  {sj-.  Let  Uj  denote  the  set  of  states 
{RlSj,  (vj.  Zj)),  R(s.,  (o-j ,  z2)). . .}  for  all  (or,  z)  in  £  X  Z  which  are  such  that  R(si,  (<r,  z))  is 
defined.  Recursively,  let  Uk+1  denote  the  set  of  states  {r(sx>  (*j,  Zj)).R(sx>  (»  ,  z2)),. .  . 
R(sy,  (<Tj.  Zj)),  R(sy,  ((Tj,  z2)). .  .}  for  all  s^  and  sy  in  Uk  and  for  all  (it,  z)  in  2  X  Z  which 
are  such  that  the  function  R  is  defined. 

First,  we  claim  that,  at  most,  n  sets  of  states,  from  UQ  up  to  Un,  would  consist 
of  only  one  state  in  each  set,  for  if  there  are  n+1  or  more  sets  consisting  of  only  one 
state  in  each  set,  two  or  more  such  sets  would  be  identical.  That  is,  there  are  loops 
around  these  sets,  and  Sj  will  have  an  infinite  memory  order  with  respect  to  the  input- 
output  sequence. 


Second,  we  claim  that  if  Uk  +  j  has  a  unique  final  state  with  respect  to  the  input-output 
sequence  (that  is,  if  each  of  UQ,  Uj  . .  .  U^,  Uk+J  has  a  unique  final  state  with  respect  to 
the  input-output  sequence  by  Theorem  31),  then  there  must  be  a  pair  of  states  in  Uk+1 
which  have  not  occurred  in  the  same  set  of  the  collection  UQ,  Uj  .  .  .  U^.  Suppose  that  the 
converse  is  true.  For  a  pair  of  states  s^  and  sy  in  Uk+j,  any  pair  of  states  from  the 
set  {R(sx,  (ffi>  Zj)),  R(sx,  (o'j ,  z2)).  . .  R(Sy,  (<Tj,  Zj)),  R(sy,  (»j.  z2)).  .  .}  must  have  a  unique 
final  state  with  respect  to  the  input-output  sequence  because  s  and  s  have  appeared 
in  previous  sets.  Moreover,  this  relationship  is  true  for  all  pairs  of  states  in 
Thus  Uk+2  will  have  a  unique  final  state  with  respect  to  the  input-output  sequence.  How¬ 
ever,  every  pair  of  states  in  Uk+2  must  have  appeared,  in  pair,  in  the  previous  sets 
U0.  Uj . . .  Uk+1.  This  argument  can  be  repeated,  and  s^  has  an  infinite  memory  order 
with  respect  to  the  input-output  sequence.  Since  the  sufficient  condition  for  every  state 
in  an  automaton  to  have  an  infinite  memory  order  with  respect  to  the  input-output 
sequence  is  that  every  pair  of  states  has  a  unique  final  state  (see  Theorem  10),  if  Sj  has 
a  finite  memory  order,  then  there  must  be  at  least  one  pair  of  states  that  does  not  have 
a  unique  final  state.  That  is,  there  are  at  most  [n(n-l)/2]  -  1  sets  among  UQ,  Uj,  U2> . .  Uk 
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that  will  consist  of  two  or  more  states  and  will  have  a  unique  final  state  with  respect 
to  the  input-output  sequence  because  there  are  n(n-l)/2  different  pairs  of  states  alto¬ 
gether. 

Therefore,  we  can  conclude  that  if  Sj  has  a  finite  memory  order  p  with  respect  to 
the  input-output  sequence,  then  p  <  (n-1)  +  [n(n-l)/2]  -  1;  otherwise,  s.  would  have  an 
infinite  memory  order.  Q.  E.  D. 

Now  we  are  able  to  determine  the  memory  order  of  a  state  s^  with  respect  to  the 
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input-output  sequence.  If  the  automaton  starts  from  UQ  =  {8j}  and  if  the  present  input 
and  output  symbols  are  unknown,  Uj  will  be  the  set  of  all  possible  next  states.  If  Uj 
does  not  have  a  unique  final  state  with  respect  to  the  input-output 
sequence,  then  si  has  a  zero  memory  order  with  respect  to  the  input- 
output  sequence.  If  Uj  does  have  a  unique  final  state  with  respect 
to  the  input-output  sequence,  we  can  determine  whether  or  not 
has  a  unique  final  state  with  respect  to  the  input-output  sequence. 

If  not,  s^  has  a  memory  order  equal  to  1  with  respect  to  the  input- 
output  sequence;  if  so,  we  shall  continue  to  repeat  this  procedure. 
From  Theorem  32  we  know  that  this  procedure  will  terminate  after , 
at  most,  n  +  [n(n-l)/2]  -  2  repetitions.  Figure  54  illustrates  this 
procedure.  To  find  the  memory  order  of  Sj  with  respect  to  the  input- 
output  sequence,  we  start  from  Sj  and  step  by  step  list  the  possible 
next  states  for  unknown  input  and  output  symbols  (Fig.  54d).  This 
procedure  terminates  when  we  come  to  the  set  {s,,S2,  s^},  which 
does  not  have  a  unique  final  state  with  respect  to  the  input-output 
sequence  (Fig.  54c).  Therefore,  Sj  has  a  memory  order  equal  to 
6.  In  general,  we  have  to  follow  the  same  procedure  to  find  the  mem¬ 
ory  orders  of  s2>  and  s4-  However,  it  happens  that  the  memory 
orders  of  s2,  s3>  and  s4  can  be  observed  immediately  to  be  5,  4,  and  3,  respectively, 
from  Fig.  54d.  Therefore,  no  further  repetition  of  this  procedure  for  each  state  is 
needed. 

Suppose  that  we  start  from  Sj  and  have  an  input -output  sequence:  (-,-)  (-,-)  (-.-) 

(_,_)  (0. 1)  (1,  1)  (1,  1)  (1,0),  where  the  first  six  input-output  symbol  pairs 

are  unknown.  We  can  determine  the  final  state  by  constructing  a  portion  of  as 

shown  in  Fig.  55. 

5.  3  MEMORY  ORDER  WITH  RESPECT  TO  THE  OUTPUT 

As  pointed  out  in  Section  IU,  when  we  study  the  memory  aspects  of  an  automaton 
with  respect  to  the  output  symbols,  under  certain  special  conditions  we  can  apply  the 
results  from  the  study  of  the  memory  aspects  of  an  automaton  with  respect  to  the  input 
symbols  or  with  respect  to  the  input  and  output  symbols.  Here,  we  shall  study  the  mem¬ 
ory  order  of  states  with  respect  to  the  output  for  all  automata. 

DEFINITION  29:  In  an  automaton  A  =  {2,  Z,  S,  M,  N},  a  state  Sj  has  a  memory 
order  equal  to  p  with  respect  to  the  output  if,  for  any  output  sequence  y  with  L(y) 
greater  than  or  equal  to  a  specific  constant  K  for  the  automaton  A,  the  set  of  states 
{Q(si,y1),Q(s.,y2). ..}  (where  yj,  y2  . . .  are  all  output  sequences  of  length  p  so  that 
the  function  Q  is  defined),  has  a  unique  intermediate  state  with  respect  to  the  out¬ 
put.  Moreover,  for  some  output  sequence  y'  of  any  arbitrary  length  the  set  of  states 
{Q(si.y'1).Q(81,y^). . .}  (where  y^  and  y^. .  .  are  output  sequences  of  length  p  +  1  so  that 
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the  function  Q  is  defined),  does  not  have  a  unique  intermediate  state  with  respect  to 
the  output. 

DEFINITION  30:  In  an  automaton  A  =  {S,  Z,  S,  M,  N}.  a  state  ai  has  an  infinite  mem¬ 
ory  order  with  respect  to  the  output,  if  for  any  output  sequence  y,  with  L(y)  greater 
than  or  equal  to  a  specific  constant  K  for  the  automaton  A,  the  set  of  states 
(Qtej.yjJ.Qts^yj)-  •  •}  (where  yj,  y2  . . .  are  all  output  sequences  of  the  same  length  so 
that  the  function  Q  is  defined),  has  a  unique  intermediate  state  with  respect  to  the  out¬ 
put. 

DEFINITION  31:  In  an  automaton  A  =  {E,  Z,  S,  M,  N}.  a  state  s.  has  a  minus  infinity 
memory  order  with  respect  to  the  output  if  there  exists  a  nonempty  output  sequence 
y  that  is  such  that  for  some  output  sequence  y'  of  any  arbitrary  length  0(8^  y)  does 
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not  have  a  unique  intermediate  state. 

THEOREM  33:  For  any  output  sequence  y  with  L(y)  5  n(n-l)/2,  a  set  of  states 
s.,  s.,  Si. . . .  in  an  automaton  A  =  {e,  Z,  S,  M,  N}  will  have  a  unique  intermediate  state 
with  I'espect  to  the  output  if  every  pair  of  states  in  this  set  has  a  unique  next  state  with 
respect  to  the  output. 

COROLLARY  16:  In  Definition  29  K  *n(n-l)/2. 

The  proof  of  Theorem  33  follows  immediately  from  Lemmas  4  and  5. 

THEOREM  34:  Let  Vk  denote  the  set  of  states  {s^s^,  sk>  .  .},  and  Vk+1  denote  the 
set  of  states  {Q(s.,  Zj),  Q(si#  z2), . . .  Q(Sj.  Zj).Q(Sj,  z2), . . .}  for  all  s  in  Vk  and  all  z 
in  Z  so  that  the  function  Q  is  defined.  If  Vk  does  not  have  a  unique  intermediate  slate 
for  some  output  sequence  y'  of  any  arbitrary  length,  then  neither  does  Vk+j.  If  Vk+1 
has  a  unique  intermediate  state  for  any  output  sequence  y  with  L(y)  larger  than  or  equal 
to  a  specific  constant  K  for  the  automaton  A,  then  so  does  Vk- 

THEOREM  35:  For  any  state  si  having  a  finite  memory  order  equal  to  p  with 
respect  to  the  output  in  an  automaton  A  consisting  of  n  states,  p  «  [n(n-l)/2]  -  2. 

The  proofs  of  Theorems  34  and  35  are  similar  to  those  of  Theorems  31  and  32  and 
will  not  be  repeated  here. 

Figure  56  illustrates  the  procedure  for  finding  the  memory  order  of  a  state  with 
respect  to  the  output.  From  Fig.  56,  we  know  that  Sj  has  a  memory  order  equal  to 
zero  with  respect  to  the  output,  s2  has  a  memory  order  equal  to  infinity,  and  s^  has 
a  memory  order  equal  to  minus  infinity.  A  state  having  a  memory  order  equal  to  minus 
infinity  is  detected  easily  in  the  checking  table  by  the  unchecked  diagonal  box. 
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VI.  CONCLUSION 


We  have  discussed  several  classes  of  finite  automata  whose  final  behaviors  can  be 
determined  uniquely,  even  if  their  initial  states  or  input  sequences  are  not  completely 
known.  In  Section  III  we  studied  the  dependence  of  the  final  slates  of  finite  automata 
upon  their  initial  states.  For  an  automaton  having  a  finite  memory  span  m  with  respect 
to  the  input,  its  final  state  can  bp  determined  uniquely  whenever  the  last  m+1  input  sym¬ 
bols  are  known.  That  is,  after  more  than  m+ 1  input  symbols  are  received,  the  behavior 
of  an  automaton  having  a  finite  memory  span  m  is  affected  neither  by  the  initial  state 
of  the  automaton  nor  by  any  input  symbol  preceding  the  most  recent  m+1  symbols. 

Our  investigation  of  an  automaton  having  a  finite  memory  span  with  respect  to  the 
input  was  extended  to  include  an  automaton  having  a  finite  memory  span  with  respect 
to  the  input-output  sequence,  where  the  final  state  of  an  automaton  can  be  determined 
when  the  last  (m+1)  input  symbols  to  the  automaton  and  their  corresponding  (m+1)  output 
symbols  are  known.  However,  although  the  information  about  the  initial  state  of  the 
automaton  is  not  explicitly  needed  in  the  determination  of  the  final  state,  the  output 
sequence  corresponding  to  the  input  sequence  does  provide  some  information  about  the 
initial  state  of  the  automaton.  The  output  sequence  provides  this  information  because 
for  a  given  input  sequence,  only  the  states  in  a  certain  subset  are  the  possible  initial 
states  that  will  generate  that  given  output  sequence. 

A  further  extension  is  to  automata  having  a  finite  memory  span  with  respect  to  the 
output.  Since  knowing  the  present  state  of  an  automaton  and  the  output  symbol  from  the 
automaton  is  not  always  sufficient  to  determine  the  next  state  of  the  automaton  if  the 
input  symbol  is  unknown,  the  memory  span  of  an  automaton  with  respect  to  the  output 
is  defined  somewhat  differently. 

In  Section  IV,  the  dependence  of  the  final  states  of  finite  automata  upon  their  initial 
states  is  studied  from  another  point  of  view.  In  this  section,  we  are  interested  in  the 
existence  of  one  or  more  input  sequences,  called  synchronizing  sequences,  that  will 
lead  an  automaton  to  the  same  final  state  for  a  set  of  different  initial  states.  An  autom¬ 
aton  having  a  finite  memory  span  with  respect  to  the  input  which  is  discussed  in 
Section  III  is  obviously  a  special  case  in  which  all  input  sequences  of  length  m+1  or  more 
are  synchronizing  sequences  for  the  set  of  all  states  of  the  automaton  (m  is  the  value 
of  the  memory  span  with  respect  to  the  input). 

In  Section  V,  we  studied  the  dependence  of  the  final  state  of  an  automaton  upon  the 
input  sequence.  We  found  that  for  a  special  class  of  automata,  their  final  states  can 
be  determined  uniquely  when  their  initial  states  are  known  but  some  of  the  input  symbols 
are  unknown.  The  possibility  of  determining  the  final  state  of  an  automaton  when  some 
input  symbols  are  unknown  depends  upon  the  initial  state  of  the  automaton,  as  well  as 
the  number  of  unknown  input  symbols.  For  a  given  initial  state,  the  unique  determination 
of  the  final  state  is  possible  only  when  the  number  of  consecutive  unknown  input  symbols 
does  not  exceed  a  certain  constant  p.  The  constant  p  is  defined  as  the  memory  order 
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of  the  initial  state  with  respect  to  the  input  and  is  different,  in  general,  for  different 
states.  Also,  an  automaton  having  a  finite  memory  span  with  respect  to  the  input  is  a 
special  case  in  which  every  state  has  an  infinite  memory  order.  The  notion  of  the  mem¬ 
ory  order  of  a  state  with  respect  to  the  input  has  also  been  extended  to  the  notion  of  the 
memory  order  of  a  state  with  respect  to  the  input-output  sequence  and  with  respect  to 
the  output.  We  investigated  the  possibility  of  determining  the  final  state  of  an  automaton 
when  some  input  symbols  are  unknown  but  the  subsequent  input  symbols  and/or  the  cor¬ 
responding  subsequent  output  symbols  are  known. 

The  study  of  the  possibility  of  determining  the  final  behavior  of  an  automaton  when 
some  of  its  past  history  is  unknown  is  by  no  means  completed  with  this  report.  There 
are  interesting  cases  about  which  we  still  have  not  been  able  to.reach  a  general  con¬ 
clusion,  for  example,  the  determination  of  the  final  state  of  an  automaton  when  only  a 
portion  of  the  input  sequence  and  some  other  portion  of  the  output  sequence  (not  the 
portion  corresponding  to  the  known  portion  of  the  input  sequence)  are  known.  Another 
investigation  may  enable  us  to  understand  more  about  these,  and  it  is  believed  that  the 
techniques  developed  here  will  be  useful  in  the  study  of  related  topics. 
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APPENDIX 


DEFINITIONS  OF  MATHEMATICAL  TERMS 
Term  Definition 


Set 

Cartesian  product  of  sets 


Relation  between  two 
sets  A  and  B 

Function 


Simple  Algebra 


Semigroup 


Monoid 


Monoid  Homomorphism 


Free  Monoid 


A  well-defined  collection  of  objects. 

The  Cartesian  product  A  X  B  of  two  sets  A  and  B  are  all 
ordered  pairs  in  the  form  of  (a,b)  where  a  is  in  the  set  A 
and  b  is  in  the  set  B.  If  A  has  m  elements  and  B  has 
n  elements,  A  X  B  will  have  mn  ordered  pairs. 

A  subset  S  of  the  ordered  pairs  in  A  X  B.  For  a  €  A  and 
b  £  B,  a  R  b  (a  is  related  to  b)  if  and  only  if  (a,b)  t  S. 

A  relation  between  two  sets  A  and  B.  A  is  called  the 
domain  of  the  function;  B,  the  range  of  the  function.  We 
also  say  that  a  function  defines  a  mapping  that  maps  the 
elements  in  its  domain  into  the  elements  in  its  range. 

A  system  consists  of  (i)  a  set  A,  and  (ii)  a  mapping  of 
(AX  A)  into  A.  (Such  a  mapping  is  also  called  a  binary 
composition  in  the  set  A.) 

A  simple  algebra  with  an  associative  binary  composition. 

A  binary  composition,  •,  is  associative  if  (a-b)  •  c  = 
a  •  (b*c). 

A  semigroup  with  a  neutral  element.  An  element  e  in  the 
set  A  is  called  a  neutral  element  for  a  binary  composition 

•  in  the  set  A,  if  e  •  a  s  a  •  e  s  a  for  all  a  £  A. 

A  mapping  f  from  a  monoid  A  into  another  monoid  B  so 
that 

(i)  f  maps  the  neutral  element  e^  of  A  into  the  neutral 
elements  e^  of  B. 

(ii)  If  aj,  a2  are  elements  in  A,  then  f(aj»a2)  = 
f(a j )  •  f(a2),  where  •  is  the  binary  composition  in  A  and 

•  is  the  binary  composition  in  B. 

Let  2  be  any  set.  Assume  that  we  are  given  a  monoid  F 
and  a  mapping  i|i  of  £  into  F.  We  shall  say  that  F 
(together  with  t|>)  is  a  free  monoid  on  the  set  2,  if  for  any 
mapping  $  of  2  into  any  monoid  A,  there  exists  a  unique 
monoid  homomorphism  f  of  F  into  A  which  is  such  that 
fMs))  =  <(>(s).  (See  Fig.  57.) 
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Term 


Definition 


Equivalence  Relation 


Equivalence  Class 


Congruence  Relation 


Congruence  Class 


Partition  of  a  set 


A  relation  R  in  A  X  A  which  is  such  that  for  all  aj,  a?,  a} 
in  A 

(i)  aj  R  aj  (reflexive  property) 

(ii)  Sj  R  a2  implies  that  a2  R  Sj  (symmetric  property) 
(iii)  aj  R  a2  and  a2  R  a3  implies  that  aj  R  a3  (transi¬ 
tive  property). 

Let  R  be  an  equivalence  relation  in  the  set  A  and  a^  be 
any  element  in  A.  The  equivalence  class  of  a^  under  R 
is  the  largest  subset  of  elements  a2,  a3  .  . .  in  A  which 
are  such  that  Sj  R  a2,  a^  R  a3  . .  .  . 

Let  A  be  a  simple  algebra.  Let  •  denote  its  binary  com¬ 
position.  An  equivalence  relation  R  in  the  set  of  elements 
of  A  is  called  a  congruence  relation  if,  for  any  a,  x,  y  in 
the  set  of  elements  of  A, 

(i)  x  R  y  implies  that  a  •  x  R  a  •  y  (left  invariance) 

(ii)  x  R  y  implies  that  x  •  a  R  y  »  a  (right  invariance). 

An  equivalence  class  of  elements  under  a  congruence  rela¬ 
tion  over  a  simple  algebra. 

Subdivision  of  a  set  into  subsets  that  are  disjoint  and 
exhaustive . 
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